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CHAPTER  I 


INTRODUCTION 


In  June  1972,  a report  was  published  (Siegel,  Wolf,  & Leahy,  1972) 
which  describes  a new  digital  computer  model  for  simulation  of  message 
processing  tasks  performed  by  field  army  personnel  during  a Tactical 
Operations  System  (TOS)  mission.  That  report  defined  variables,  de- 
scribed a computational  logic  flow  which  integrated  the  variables  into  a co- 
herent digital  simulation  model,  and  presented  the  results  of  initial  tests 
of  model  sensitivity. 

As  a result  of  model  utilization  and  testing,  a number  of  avenues 
for  model  improvement  became  evident.  These  may  be  grouped  into  the 
following  three  general  categories: 

1.  extension  to  allow  an  experimenter,  seated  at  a 
CRT  display  terminal,  to  initiate,  control,  and 
monitor  results  from  simulation  runs 

2.  extension  to  allow  one  or  more  subjects,  seated  at 
CRT  display  terminals,  to  participate  in  the  simu- 
lated TOS  exercise,  by  performing  specific  TOS 
tasks,  selected  as  not  best  allocable  to  digital 
simulation,  while  the  model  simulates  the  balance 
of  the  tasks 

3.  strengthening  of  the  model  by  incorporating  changes 
such  as  an  improved  system  responsiveness  calcu- 
lation scheme,  an  improved  stress  function,  and 

an  extension  of  the  shift  limit  capacity 
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The  current  report  has  as  its  purpose  the  description  of  the  imple-  | 

mentation  of  the  three  sets  of  features  into  the  previously  developed  model.  J 

To  achieve  the  desired  result,  the  computer  program  (Siegel,  Wolf,  & Leahy,  ;| 

1972)  representing  the  model  was  modified  and,  as  a result  of  changes  de-  j 

scribed  herein,  two  new  computer  programs  were  developed.  f 


The  first  is  a program  which  is  a revision  of  the  basic  model  contain-  3 

ing  improvements  only  and  does  not  contain  interactive  features.  This  is  J 

termed  the  "Strengthened  Model.  " The  second  is  an  extended  model  which  J 

incorporates  the  changes  required  for  the  interactive  features  including  both  J 

the  experimenter  and  subject  interaction,  as  well  as  the  model  improvements  \ 


included  in  the  "strengthened  model"  (with  the  exception  of  shift  extensions, 
which  are  impractical  for  interactive  runs).  This  is  called  the  "Interactive 
Mode'.  " 

The  remainder  of  this  chapter  presents  an  overview  of  the  original 
model  in  preparation  for  the  more  detailed  description  ot  the  three  major 
feature  changes  which  are  presented  in  Chapters  II,  III,  and  IV  respective- 
ly. The  re-id er  who  is  already  familiar  with  the  general  functional  capabil- 
ities of  the  basic  model  may  wish  to  turn  directly  to  Chapter  II. 

The  TOS  Computer  Simulation 

The  TQS  simulation  model  combines  the  effects  of  such  features 
as  message  queuing,  detailed  message  processing  procedure,  error  rates, 
and  personnel  characteristics,  along  with  stochastic  variations  to  yield 
predictions  of  system  performance.  Parameters  which  may  be  varied  to 
study  their  impact  on  system  performance  include: 

- hours  per  shift 

- number  of  action  officers 

- number  of  IOD  operators 

- operator  fatigue 

- error  rates  (per  hour,  per  type  of  error,  per 
type  of  message) 

- personnel  characters  (4  variables) 

- message  arrival  frequency 

- message  workload 

- message  type  mix 

- message  length 

- message  handling  procedure 

Specifically,  oh  the  basis  of  input  data,  the  model  generates  mes- 
sage workload  for  the  first  hour  of  a shift  for  the  simulated  TOS  person- 
nel. It  assigns  priorities  and  other  characteristics  to  the  simulated  mes- 
sage and  forms  a message  queue.  Then,  the  simulation  of  the  processing 
of  these  messages  by  the  AO  and  IOD  personnel  takes  place  to  yield  the 
hourly  output  record,  as  described  below.  When  the  simulation  is  com- 
pleted for  the  first  hour  of  the  shift,  a message  workload  is  generated  for 
the  second  hour.  Messages  which  were  carried  over  from  the  first  hour 
are  added  to  this  second  hour  workload,  and  the  simulation  of  the  process- 
ing for  the  second  hour  of  the  shift  takes  place.  An  hourly  summary  for 
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the  second  hour  is  then  produced.  This  procedure  continues  until  the  to- 
tal shift  has  been  simulated,  at  which  point  a summary  for  the  shift  is  pro- 
duced. 

Due  to  the  stochastic  nature  of  many  of  the  simulation  aspects,  a 
number  of  repetitions  is  required  to  produce  a stable  result.  Repetitions 
of  a simulation  with  tne  same  set  of  input  variable  conditions  is  called  a 
run.  At  the  conclusion  of  a run,  the  run  summary  (integrating  results  of 
various  repetitions)  is  produced. 

The  program  allows  for  detailed  message  processing  description, 
hourly  summary,  shift  summary,  and  run  summary  output  options.  The 
detailed  message  processing  output  shows  the  fine  grain  of  the  results  of 
the  simulation  of  action  officer's  selection  and  formating,  followed  by  lOD 
processing  of  the  messages  which  arrive  each  hour  of  a shift. 

The  hourly  summary  presents  a consolidation  of  the  results  of  a 
simulated  hour's  work  and  includes  items  such  as:  number  of  messages 
completed,  number  of  messages  rejected,  number  of  messages  unproc- 
essed, time  spent  working,  end  of  hour  stress  level,  end  of  hour  level 
of  aspiration,  time  spent  performing  various  processes,  average  time 
per  message,  errors,  and  information  loss. 

The  shift  summary,  produced  at  the  conclusion  of  one  n hour  shift, 
provides  a consolidation  of  certain  information  derived  at  the  end  of  esc-1 
hour,  e.  g. , total  messages  processed,  time  worked,  overall  effective- 
ness, errors. 

The  simulation  run  summary,  produced  after  N simulations  of  the 
same  shift,  consists  of  five  parts — manpower  utilization,  message  process- 
ing times,  overall  effectiveness  indicator,  workload  summary,  and  error 
summary.  The  manpower  utilisation  summary  shows  the  mean  time  each 
man  worked  for  each  of  the  simulated  hours,  the  mean  amount  of  time 
each  man  spent  on  a message  by  each  hour,  and  the  final  stress  and  as- 
piration levels  of  each  man.  The  message  processing  time  summary 
shows  by  message  type,  priority,  and  hour  the  amount  of  time  spent  in 
each  of  five  time  segments.  The  effectiveness  components — thoroughness, 
completeness,  responsiveness  and  accuracy,  as  well  as  overall  effective- 
ness— are  also  shown  for  each  simulated  hour.  Tne  run  workload  sum- 
mary contains  the  mean  number  of  arriving  messages  which  were  com- 
pleted or  carried  over  during  each  simulated  hour,  as  well  as  the  number 
of  rejected  or  interrupted  messages. 
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The  error  summary  shows  the  mean  number  of  errors  of  various 
types  (i.  e. , omission,  abbreviation/ typographic/ spacing,  or  commision) 
for  each  hour  and  for  each  message  type. 

The  end  result  is  the  ability  to  answer  questions  such  as: 

1.  How  does  system  effectiveness  vary  as  a function 
of  message  load? 

2.  How  does  system  effectiveness  vary  as  a function 
of  message  arrival  time  distribution? 

3.  How  does  system  effectiveness  vary  as  a function 
of  personnel  proficiency? 

4.  What  is  the  effect  of  increasing  or  decreasing  the 
manning  level  or  personne'  proficiency? 

5.  How  much  stress  was  on  the  operators  during  the 
performance  of  the  work  of  each  hour? 

6.  How  does  system  effectiveness  vary  as  a function 
o.  operator  level  of  aspiration? 

7.  What  is  the  error  rate  for  various  message  types 
and  for  various  mannings  and  personnel  attributes 
within  manning? 

3.  How  much  time  was  spent,  on  the  average,  proc- 
essing each  type  of  message? 

9.  How  much  time  was  spent,  on  the  average,  for  each 
type  of  message  in  performing  acts  such  as:  mes- 
sage screen,  message  transform,  transformed  mes- 
sage input? 

10.  How  many  error  returns  were  involved  for  each  type 
of  message? 

11.  What  is  the  success  rate? 

12.  How  effective  was  the  work  in  terms  of  the  following 
four  criteria:  accuracy,  thoroughness,  responsive- 
ness, and  completeness? 
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CHAPTER  II 


THE  STRENGTHENED  MODEL 


Introduction 


Six  enhancements  to  the  basic  model  were  developed  and  tested  as 
a part  of  the  current  work.  These  are  itemized  below  and  described  in 
subsequent  sections  of  this  chapter: 


1.  revision  of  the  responsiveness  formula  in  the  sys- 
tem effectiveness  calculation  and  a correction  of  the 
formula  for  calculating  the  systems  effectiveness 
index 


2.  addition  of  the  capability  to  generate  more  than  one 
TOS  message  from  a single  input  message 


3.  correction  of  the  calculation  for  the  number  of  un- 
detected errors 


4.  incorporation  of  the  effects  of  message  priority  on 
operator  stress 


5.  extension  of  the  existing  limit  from  one  shift  of  up 
to  12  hours  to  as  long  as  24  hours  (including  up  to 
four  shifts) 


6.  improvement  in  the  content  and  format  of  the  printed 
output 


Appendix  A to  this  report  presents  a revised  user's  manual  for  the 
Strengthened  Model  including:  principal  subscripts,  card  types  and  function, 
card  layouts,  a glossary  of  variables,  and  subroutine  names  and  functions. 
The  revised  model  flow  logic  is  presented  in  Appendix  C for  the  Interactive 
Model  (i.  e. , including  the  Strengthened  Model). 


He  s p o n s i v e n e s s 


A numerical  value  for  the  total  system  effectiveness  is  calculated 
after  each  hour  of  simulated  operation.  Within  the  simulation,  effective- 
ness is  a function  of  four  factors:  responsiveness,  completeness,  thorough- 
ness, and  accuracy.  A reexamination  of  the  results  of  prior  runs  indicated 
that  the  responsiveness  component  yielded  unreasonably  small  values  when 
compared  on  a corresponding  scale  with  the  others. 

In  a reevaluation  of  this  function,  it  was  determined  that  this  im- 
portant measure  should  properly  be  calculated  on  the  basis  of  two  independ- 
ent factors.  First,  there  is  Lhe  basic  operator  responsiveness  which  should 
measure  the  speed  with  which  tne  assigned  operators  are  able  to  process 
an  average  incoming  message,  once  they  have  begun  to  work  on  it.  Second, 
there  is  the  equally  important  system  criteria  which  should  measure  the 
queue  waiting  time  of  messages  prior  to  operator  processing. 

To  accomplish  this  conjoint  consideration,  two  new  variables,  aver- 
age handling  time  (AHT)  and  average  queue  time  (AQT),  were  introduced. 
These  are  calculated  at  the  end  of  each  mission  hour  as  means  over  all  oper- 
ators for  the  hour.  From  these  data,  two  multiplicative  factors,  Y1  and  Y2, 
are  calculated,  as  shown  in  Figure  2-1.  The  resultant  responsiveness  meas- 
ure [ EC(3)]  is  then  calculated  as  EC(3)  = Yl*  Y2  and  is  limited  to  the  range 
zero  to  one. 

The  functions  in  Figure  2-1  were  developed  so  that: 

1.  the  first  factor  will  have  a value  of  one  (perfect 
score)  as  long  as  the  AHT  is  less  than  half  of  the 
TOS  average  message  handling  time  of  600  sec- 
onds 

2.  Yl  will  have  a value  of  0.  7 when  the  results  for  the 
hour  equal  the  TOS  average  of  600  seconds 

3.  Y2  will  have  a value  of  one  (no  degradation  of  Yl 
score)  when  the  average  message  is  in  the  queue 
for  five  minutes  or  less 

4.  Y2  will  have  a value  of  0.  8 when  the  average  mes- 
sage is  in  the  queue  for  20  minutes 

5.  linear  relationships  hold  for  other  values 
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Y1  = 1 

Y1  = 1.3  - 0.  OOl(AHT) 
0 < Y1  < 1 


if  AHT  < 300 
if  AHT  > 300 


and 


Y2  = 1 

Y2  = 1.0666  - 0.000222 
0 £ Y2  < 1 


if  AQT  < 300 
if  AQT  > 300 
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Results  from  this  implementation  have  yielded  more  reasonable  re- 
sponsiveness [EC(3)]  and  system  effectiveness  values. 

Correct  ion  of  Effectiveness  Fornula 

The  formula  for  the  effectiveness  calculation  which  combines  four 
factors- -accuracy,  thoroughness,  responsiveness,  and  completeness- - 
was  presented  and  its  characteristics  described  previously  (Siegel,  Wolf, 

& Leahy,  1972).  However,  the  calculation  was  incorporated  into  the  model 
erroneously.  The  correct  FORTRAN  representation  follows; 
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_ ^(CC12)2  +(CC13)2  +(CC14)2  +(CC23)a  + (CC24)2  + (CC34)*j  # 

[W(1)EC(1)  + W(2)EC(2)  + W(3)EC(3)  + W(4)EC(4)] 

+ |~6  ~ <CC12)a  + (CC13>?  + (CCU)a  + (CC23)a  + (CC24)2  (CC34)2  j # 


[EC(1)W(1>3[EC(Z)W(2>KEC(3)W(3)][EC(4)W<4>] 


where: 


EFF  = effectiveness 

CC12  = correlation  between  thoroughness  and  completeness 

CC13  = correlation  between  thoroughness  and  responsiveness 

CC14  = correlation  between  thoroughness  and  accuracy 

CC23  = correlation  between  completeness  and  responsiveness 

CC24  = correlation  between  completeness  and  accuracy 

CC34  « correlation  between  responsiveness  and  accuracy 

W(IC)  = weight  for  each  component 

EC\1)  = thoroughness 

EC(2)  = completeness 

EC(3)  = responsiveness 

EC(4)  = accuracy 
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Multiple  Input  Messages 

In  the  field,  it  is  not  uncommon  that  a message  entering  the  system 
for  automation  will  in  fact  generate  more  than  one  TOS  input  stimulus  mes- 
sage, each  of  wh;ch  must  be  processed  by  the  operational  personnel  on 
duty.  Incorporation  of  this  feature  would  not  only  yield  improved  realism, 
but  would  allow  the  system  analyst  to  determine  the  effect  of  the  ratio  (num- 
ber of  generated  to  input  messages)  on  system  performance  efficiency. 

To  accomplish  this  enhancement,  a new  item  was  added  to  the  model 
input  data,  RMPS(IT),  which  specifies  the  average  number  of  TOS  messages 
entered  into  the  TOS  system  as  a result  of  input  stimulus  messages  of  each 
type.  The  program  was  modified  to  accept  thesr-  inputs  and  to  calculate,  for 
each  input  stimulus  message,  a value  from  a Poisson  distribution  to  repre- 
sent the  actual  number  of  TOS  messages  to  be  processed  as  a result  of  the 
single  input  stimulus  of  type  IT:  RP(RMPS{IT).  The  message  generation 
subroutine  was  then  adjusted  to  generate  that  integral  number  of  messages 
for  processing.  Each  resulting  message  is  assigned  the  same  time  of  ar- 
rival., as  calculated  by  MESGEN,  althoug  \ the  other  message  characteris- 
tics (priority,  type,  length)  are  calculated  independently. 


Undetected  Errors 

Previously,  the  number  of  undetected  errors  was  calculated  as  a 
Poisson  distributed  variable  as  a function  of  the  operator  rates  provided 
as  input,  and  of  the  message  length.  A review  of  this  function  resulted 
in  the  conclusion  that  operator  accuracy,  included  in  the  model  as  the 
precision  variable,  PREC(M),  should  also  be  incorporated  into  the  unde- 
tected error  calculation.  Since  precision  is  scaled  from  1.2  (highly  inac- 
curate operator)  to  0. 8 (highly  accurate  operator),  the  precision  factor 
was  made  a multiplicative  factor,  and  the  resulting  calculation  became: 


TNUE  = gRP[ER(IE,  IT)  ~^~'-^3PREC(M) 


where: 


TNUE  = total  number  of  undetected  errors 
RP  = Poisson  distributed  variable 

ER  = error  rate 

LENGTH  = no.  of  characters  in  the  message 
PREC(M)  = operator  precision 
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Revised  Stress  Calculation 

Previously,  the  stress  of  an  operator  performing  a TOS  mission 
was  determined  as  a function  of  the  number  of  nonroutine  messages  in  the 
queue  (inbasket),  the  number  of  available  crew  members  to  process  mes- 
sages, and  the  operator  stress  threshold  values  provided  as  input  param- 
eters. It  was  decided  that  the  logic  of  this  calculation  would  be  improved 
if  all  five  levels  of  message  priority  were  algo  considered.  Accordingly, 
the  logic  was  modified  to  allow  message  priority,  as  well  as  number  of 
available  operators  and  number  of  messages  in  the  queue  to  affect  opera- 
tor stress.  In  the  modification,  routine  messages  exert  no  additional 
stress  effect,  while  messages  of  the  other  four  priority  categories  in- 
fluence stress.  Specifically,  messages  having  higher  priorities  count 
as  more  than  one  message  in  the  queue,  as  shown  in  the  Table  2-1. 

Table  2-1 

Assigned  Message  Equivalents  for  Each  Type  of  Priority 


Priorit 


Type  of  Priorit 


Number  of 
Equivalent  Messages 
ISTKNT(IP) 


Comment 


routine 

priority 

operational  immediate 
flash 

presidential  interrupt 


no  change 
no  change 

increased  importance 
increased  importance 
increased  importance 


The  effect  of  this  change  is  to  generate  a higher  operator  stress  con- 
dition in  the  cases  in  which  higher  priority  messages  are  in  the  queue. 


Extension  of  the  Simulation  Limit 

As  originally  designed,  the  model  was  capable  of  simulating  operator 
shifts  of  up  to  12  hours.  Thus,  the  original  model  handled  crew  (shift) 
changes  only  by  multiple  runs.  However,  since  the  TOS  mission  is  actually 
executed  in  shifts,  a logical  extension  to  the  model  was  the  incorporation  of 
the  capability  to  simulate  a full  24  hour  day  including  several  shift  changes. 


This  extension  of  capability  represents  a major  logical  change  to 
the  program  as  it  involves  program  changes  to  allow  reading  of  new  oper- 
ator parameter  data  (to  simulate  the  phanging  of  personnel)  at  the  end  of 
each  work  shift,  along  with  required  storage  of  simulation  results  for 
each  shift  and  a summarization  at  the  completion. 

To  incorporate  this  multishift  concept,  two  new  items  of  data 
were  added  to  the  mission  input,  the  number  of  the  shift  being  simulated 
(ICHAIN)  and  the  time  at  beginning  of  the  shift  (TZERO).  The  input 
NSHIFT  (number  of  iterations  per  shift)  remains  unchanged. 

The  computer  program  was  modified  to  accomplish  the  logic  as 
shown  in  flow  chart  X.  These  additions  occur  after  the  subroutine  ITSUM 
following  circle  f in  the  Appendix  C flow  charts.  The  modifications  ac- 
complished the  following; 

1.  after  subroutine  ITSUM  summarizes  results  of  one 
shift  of  IHMAX  hours,  the  remaining  message  queue 
is  saved  to  be  used  as  the  backlog  queue  of  the  cor- 
responding iteration  of  the  next  shift 

2.  simulations  of  IHMAX  hour  shifts  are  continued  and 
summarized  until  all  NSHIFT  iterations  are  com- 
pleted 

3.  then  subroutine  RUNSUM  summarizes  the  results  of 
iterations  of  that  shift  in  a Run  Summary 

4.  the  process  repeats  for  all  additional  required  shifts 

5.  when  all  required  shifts  have  been  simulated  (NSHIFT 
iterations  each),  a final  summary  is  calculated  and 
printed 


Revised  output  tabulation  forms  result  from  these  changes.  For 
reference  purposes,  a complete  set  of  sample  output  tabulation  formats  is 
itemized  in  Table  2-2  and  presented  in  Figures  2-2  through  2-9a. 
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Figure  J-5.  Semple  dc-teiled  message  processing  output. 
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Figure  2-9,  Sample  simulation  shift  summary, 


'isa? 


81 ,, 


J S(*l 
ZQ.ru  , 


*-  r)  -« n 

OVl  ^ • 


it- 


I O 3 q 

• oc  • * 


• oJ  lf»  <0 

• z » 

I « I 

'"  I 

ll*<N 
I 39^ 

irl 

i j 

’*  ilON 


t ui  in  <d  , 
i *♦» 
l — « ru  oi 
a *-  j 


n t i ^ ji 

» o »» 
j i x • « 
: i x 
«•  CM 

I Ul  Z>  4 

• X -•  3 


I 1 ^ 
a a . 
12  » I 

s*  j 

a z -*  i 

{ I 


« ran 
►-an 

vjuj  Wf-  » 

un*  W-*  * 

ikui  i • • 


iu  0(0  9 

,*+•  - 

SftSIS  3 

zui  ^ • • 

gS  ) 

IIIs-  *• 

m s- 


a-  an- 

i an  m 
zoz 

r5 


!* 

& 

s I 

I*  ► 


s 

tfc 

: * * 

! * l . 


! 4*; 


BESI  AVAILABLE  COPY 


Table  2-2 


Types  of  Simulation  Output  Listing 


Listing  ' Figure 


Basic  input  data 

2-3 

Task  analytic  data 

2y3 

Message  backlog 

■ 2-4 

Detailed  message  output 

2-5 

End  of  hour  results 

2-6 

Results  of  NSHIFT  iteration 

2-7 

Run  summary 

2-8 

Shift  summary 

2-9 

Enhancements  were  also  effected  in  the  content  and  format  of  the 
printed  model  output  as  follows: 

1.  On  the  Shift  Summary 

A.  Manpower  Utilization  Results 

• the  shift  number  was  ackL 

e the  "messages  processed"  column  was  retitled 
"mog  units  processed"  to  simplify  and  clarify 
its  meaning 

• a new  row  of  total  results  for  the  IH  hour  shift 
was  added 

• a new  row  of  grand  means  was  added  to  show 
shift  results  for  the  average  hour 

B.  Time  Segment  Results 

• the  title  "N  CPL1'  wa.3  clarified  to  read  "TOTAL 
MESSAGES" 

C.  Error  Summary  Results 

• the  heading  "number  of  messages"  was  cor- 
rected to  read  "cumber  of  message  units" 
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2.  Task  Analytic  Data 

. • A new  printout  was  added  after  the  listing  of  the  task 

analyses  to  indicate  the  allocation  of  each  task  anal-  ’ 

ysis  to  each  operator  type  (IOD  and  G3)  and  to  each  } 

message  type. 

3.  Input  Data 

• A new  printout  was  added  after  the  hour  parameters 
to  show  the  new  data  on  number  of  messages  per 
stimulus  message  by  message  type. 
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CHAPTER  HI  ' 

THE  INTE RACTIVE  MODEL 


A second  basic  goal  of  the  present  work  was  to  incorporate  the 
capability  for  human  participation  t<?  control  and  interact  with  the  strength- 
ened simulation  model.  To  this  end,  the  strengthened  model  was  further 
modified,  and  additional  program  modules  were  designed  and  tested. 

Figure  3-1  presents  the  basic  data  and  system  (procedural)  flow 
for  the  interactive  model.  It  indicates  the  general  capabilities  of  the  model, 
including: 


1.  use  of  computer  disc  for  input  and  output  data 
storage 

2.  capability  to  handle  up  to  six  interactive  CRT 
terminals 

3.  background  versus  foreground  mode  on  the  CDC 
3300  computer 

4.  capability  to  list  input  data  and  results 

These  capabilities  allow  an  experimenter  or  supervisor  to  control 
simulation  runs  either  with  or  without  subjects  inline „ The  interactive  sim- 
ulation combines,  therefore,  both  physical  simulation  and  computer  simula- 
tion, taking  advantage  of  the  positive  attributes  of  both.  It  allows  the  time 
compression  and  ease  of  variable  manipulation  afforded  by  computer  simula- 
tion while,  at  the  same  time,  including,  through  physical  simulation,  those 
aspects  which  cannot  be  easily  or  validly  simulated  through  computer  simu- 
lation methods.  The  end  result  is  a hybrid  simulation  in  which  the  digital 
computer  simulates  certain  aspects  of  performance  while  online  human 
operators  perform  other  aspects,  i.  e. , aspects  not  easily  simulated  through 
computer  simulation. 

An  experimenter,  seated  at  a terminal,  can  now  perform  the  follow- 
ing: 
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1.  select,  enter,  and  verify  run  and  operator  parameters 

2.  specify  number  and  cathode  ray  tube  assignment  of 
subjects 

3.  designate  which  tasks  m a task  analysis  list  a subject 
is  to  perform 

4.  monitor  the  messages  generated  and  specify  those 
which  are  to  be  performed  by  subjects 

5.  monitor  results  of  each  hour's  processing  by  both 
computer  simulation  and  subject 

8.  observe  subject  actions  and  indicate  times  of  start 
and  end  of  tasks 

7.  monitor  subject  performance  times 

The  subject  capability  allows  an  actual  subject,  in  line  with  the  sim- 
ulation, to  perform  selected  tasks  as  designated  by  the  experimenter.  These 
tasks  can  be  CRT  monitoring,  data  enti-y,  counting,  composing,  verifying, 
and  the  like. 

The  logic  for  the  TOS  simulation  model  presented  in  the  prior  Siegel, 
Wolf,  ar.d  Leahy  (1972)  report  has  been  revised  to  reflect  the  new  interactive 
aspects  - nd  is  presented  here  as  Appendix  C. 


Displays  Presented 

A narrative  description  of  the  display  capabilities  which  have  been 
incorporated  into  the  interactive  model  is  now  presented.  This  will  serve 
to  provide: 

1.  a functional  description  of  the  interactive  changes 
in  the  TOS  simulation  model 

2.  a presentation  of  limitations  and  capabilities 

3.  a view  of  the  various  types  of  information  displayed 
to  the  subject  and  the  experimenter  during  the  use  of 
the  interactive  model 
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Prior  to  the  simulation  run  and  after  reading  and  optionally  re- 
cording the  simulation  inputs.  Figure  3-2  is  displayed  for  the  general  in- 
formation of  the  experimenter. 


GENERAL  INSTRUCTIONS- 

WHEN  EXPERIMENTER  INPUT  IS  REQUESTED. . . 
ENTER  DATA 
DEPRESS  RESET  KEY 
DEPRESS  SEND  KEY 

WHEN  READY  TO  BEGIN  DEPRESS  SEND  KEY 


Figure  3-2.  Initial  experimenter  instruction  display. 

This  informational  display  is  presented  to  the  experimenter  at  the  beginning 
of  a simulation  run. 

The  display  shown  in  Figure  3-3  is  presented  to  the  experimenter 
only  if  the  subject  is  to  participate  (i.  e. , the  subject  interface  option  (SBIN 
* 1)  has  been  selected.  The  display  enables  the  experimenter  to  enter  the 
number  of  iterations  for  the  first  simulation  run.  The  experimenter  enters 
the  value  for  ITER  (in  FORTRAN  1 2 format)  immediately  following  the  " = " 
character. 


IF  SUB.  IS  TO  PERFORM,  ENTER  NUMBER  OF 
ITERATIONS  FOR  SUBJECT  INTERFACE  ITER  = 1 BLANK 


Figure  3-3.  Iteration  entry  display 


The  next  display.  Figure  3-4,  is  ad  so  presented  to  the  experimenter 
only  if  the  subject  interface  option  has  been  selected.  Input  values  for  each 
man  in  the  simulation  are  displayed  to  the  experimenter.  For  each  man 
whose  tasks  are  to  be  performed  by  51  subject,  the  experimenter  enters  the 
subject  console  number  (replacing  the  zero)  in  the  CONSOLE  column  for 
the  man. 


OPERATOR  PARAMETERS 


MAN 

CONSOLE 

NAME 

SPEED 

ACCURACY 

THRESHOLD 

ASP. 

1 

0 

AO-1 

1.00 

1.00 

10.00 

.900 

2 

0 

-G3- 

1.00 

1.00 

10. 00 

.900 

3 

0 

I0D1 

1.00 

1.00 

10.00 

.911 

ENTER  APPROPRIATE  CONSOLE  NUMBER  FOR  EACH  MAN  WHO 
IS  TO  BE  REPLACED  BY  A SUBJECT. 


Figure  3-4.  Console  entry  display. 


The  display  shown  in  Figure  3-5  provides  the  experimenter  with  veri 
ucatipn  of  data  input  in  the  preceding  display.  If  an  error  is  noticed,  the 
experimenter  enters  YES  immediately  following  the  word  CORRECTIONS  and 
the  display  in  Figure  3-4  is  presented  again.  The  computer  program  de- 
faults to  NO  if  no  response  is  entered  by  the  experimenter  after  ten  seconds. 


SUBJECT  WILL  PERFORM  FOR  1 ITERATIONS 
SUBJECTS  WILL  USE  CRT'S  AS  FOLLOWS 


MAN  CRT 

1 2 

2 0 

3 0 

4 0 

5 0 

6 0 


ANY  CORRECTIONS? 

Figure  3-5.  Experimenter  confirmatory  display. 


Figure  3-G  picoeula  Luc  display  which  is  presented  to  the  experi- 
menter only  if  subject  console  numbers  have  been  entered  in  the  display 
shown  in  Figure  3-4.  An  "X"  is  entered  in  the  appropriate  column  for 
each  task  analysis  which  can  involve -subject  interface.  Either  all,  or 
some,  of  the  task  elements  of  a task  analysis  can  oe  affected. 

ENTER  X FOR  EACH  TASK  ANALYSIS  TO  BE 
PERFORMED  BY  A SUBJECT.  IF  ONLY  PART 
OF  A TASK  ANALYSIS  IS  TO  BE  PERFORMED 
A LISTING  BY  TASK  ELEMENT  NUMBER  WILL 
FOLLOW 


TASK  ANALYSIS 

12  3 4 

ALL  OF  //////// 

PART  OF  //////// 

Figure  3-6.  Task  analytic  selection  display. 


Figure  3-7  is  a display  presented  to  the  experimenter  for  each  task 
analysis  for  which  some  task  elements  involve  subject  interface.  For  each 
task  element  which  may  be  performed  by  a subject,  the  experimenter  re- 
places the  appropriate  S (for  simulate)  with  a P (for  perform). 


TASK  ANALYSIS  1 

CHANGE  S TO  P FOR  THOSE  TASK  ELEMENTS 
TO  BE  PERFORMED  BY  THE  SUBJECT 

123456789  10 

s s s s s s 

11  12  13  14  15  16  17  18  19  20 


Figure  3-7.  Task  element  selection  display. 
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The  display  presented  in  Figure  3-8  allows  verification  of  the  inputs 
provided  by  the  experimenter  in  the  display  of  Figure  3-7.  If  corrections 
are  necessary,  the  experimenter  enters  YES  immediately  following  CORREC- 
TIONS and  Figure  3-7  display  will  be  presented  again.  NO  is  the  default  re- 
sponse. 


TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 
TASKPS  (1, 


1)  = p 

TASKPS 

(1.  2)  = S 

3)  *•  S 

TASKPS 

(1,  4)  = S 

5)  = S 

TASKPS 

(1,  6)  = S 

7)  = S 

TASKPS 

(1,  8)  = 

9)  = 

TASKPS 

(1,  10)  = 

11)  = 

TASKPS 

(1,  12)  = 

13)  = 

TASKPS 

(1,  14)  = 

15)  = 

TASKPS 

(1,  16)  = 

17)  = 

TASKPS 

(L  18)  = 

19)  = 

TASKPS 

(1,  20)  = 

ANY  CORRECTIONS? 
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Figure  3-8,  Task  element  verification  display. 


The  next  display.  Figure  3-9,  is  presented  to  the  experimenter  at 
the  beginning  of  each  hour  in  a simulation  run,  if  subject  performance  is 
to  be  affected.  The  display  presents,  in  groups  of  eight,  messages*  that 
have  been  generated  for  the  hour.  For  each  generated  message  that  is  to 
be  replaced  by  a message  in  the  input  data,  the  identifying  number  of  the 
prestored  message  replaces  the  zero  in  the  MSG.  NO.  column.  If  appropri- 
ate, other  columns  containing  descriptive  information  about  the  message 
should  also  be  changed. 


( 


MESSAGES  GENERATED  FOR  ACTION  OFFICER  FOR 
HOUR  1 TO  INDICATE  THAT  A MESSAGE  IS  TO  BE 
PERFORMED  BY  A SUBJECT,  ENTER  A PRESTORED 
MESSAGE  NUMBER  FOR  THE  REAL  MESSAGE.  ENTER 
ANY  CHANGES  IN  APPROPRIATE  COLUMNS. 


CUMUL. 

ARRIVAL 

MSG. 

ORDER 

MSG.  NO. 

(SECS) 

PRIORITY 

TYPE  LENGTH 

NO. 

1 

0 

0 

1 

1 

31 

1 

2 

0 

0 

1 

1 

78 

2 

2 

0 

0 

-* 

A, 

1 

38 

3 

4 

0 

0 

1 

1 

27 

4 

5 

0 

0 

1 

1 

57 

5 

6 

0 

0 

1 

1 

71 

6 

7 

0 

0 

1 

i 

A 

107 

7 

8 

0 

0 

1 

1 

82 

8 

Figure  3-9.  Message  generation  display. 
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Figure  3-10  shuws  the  display  provided  to  allow  the  experimenter 
to  verify  the  previous  input.  Only  the  messages  replacing  simulation-gen- 
erated messages  are  displayed.  If  an  error  is  found,  YES  is  entered  im- 
mediately following  CORRECTIONS,  -and  the  display  shown  in  Figure  3-9  is 
presented  again.  NO  is  the  default  response. 


NEW  MESSAGES 


CUMUL. 


ARRIVAL 


COM 

MSG. 


ORDER  MSG.  No.  (SECS)  PRIOR  TYPE  LENGTH  NO. 
12  0 1 1 31  1 


Figure  3-10.  Experimenter  message  generation  verification  display. 


Figure  3-11  presents  the  information  message  displayed  to  the  experi- 
menter if  the  length  of  a prestorea  message  varies  more  than  one  standard 
deviation  from  the  mean  for  the  message  type. 


PRESTORED  MESSAGE  2 HAS  31  CHARACTERS 
SIMULATION  HAS  GENERATED  TYPE  1 MESSAGES 
BASED  ON  MEAN  = 65.  00  STANDARD  DEVIATION  = 26. 0 
DEPRESS  SEND  KEY  TQ  CONTINUE 


Figure  3-11.  Message  length  check  message. 

Figure  3-12  shows  the  informational  message  displayed  to  the  experi- 
menter if  the  input  as  shown  in  the  display  presented  as  Figure  3-9  has  in- 
troduced more  messages  of  a given  type  than  the  simulation  would  have  gen- 
erated (limited  by  FRET). 

WITH  TFE  PRESTORED  MESSAGES  REPLACING 
SIMULA'.  ’ON  - GENERATED  MESSAGES,  THERE 
ARE  1 TYPE  2 MESSAGES  INSTEAD  OF  THE 
GENERATED  3 

DEPRESS  SEND  TO  CONTINUE 

Figure  3-12.  Message  overgeneration  display. 
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The  information  message  similar  to  the  preceding  for  message 
priority  instead  of  message  type  is  given  in  Figure  3-13. 


WITH  PRESTORED  MESSAGES  REPLACING 
SIMULATION-GENERATED  MESSAGES,  THERE  ARE 
3 MESSAGES  OF  PRIORITY  1 INSTEAD  OF  THE 
GENERATED  2 DEPRESS  SEND  TO  CONTINUE 


Figure  3-13.  Message  type  overgeneration  display. 


Additional  display  messages  are  presented  to  the  subject  and/or 
experimenter  to  appraise  him  of  status  conditions  or  to  request  direction 
concerning  future  conduct  of  the  experiments. 


The  display  shown  in  Figure  3-14  indicates  to  the  experimenter  that 
a subject  may  be  selected  to  process  the  next  message.  At  this  time,  the 
experimenter  may  decide  whether  or  not  the  subject  is  to  perform.  The  ex- 
perimenter enters  YES  or  NO  accordingly.  The  default  response  is  NO. 


MESSAGE  NUMBER  1 IS  TO  BE  PROCESSED  BY 
AO-1,  MAN  NUMBER  1 

DO  YOU  WANT  THE  SUBJECT  TO  PERFORM? 


Figure  3-14.  Subject  action  display. 


The  next  message  advises  the  experimenter  that  he  has  selected  the 
subject  option  for  processing  the  indicated  task  element.  If  the  task  element 
requires  the  subject  to  enter  a message  on  the  CRT,  then  the  experimenter 
enters  YES  as  his  response.  NO  is  the  default  response. 

READY  FOR  TASK  ELEMENT  1 OF  TASK  ANALYSIS  1 
IS  SUBJECT  TO  ENTER  MESSAGE  ON  CRT? 

Figure  3-15.  Subject  option  advisory  display. 


The  next  message  (Figure  3-16)  advises  the  experimenter  to  depress 
the  SEND  key  when  he  signals  the  subject  to  begin  performing  the  task  indi- 
cated in  the  preceding  display.  (This  message  applies  to  the  mode  in  which 
the  experimenter  observes  subject  performance.) 

PLEASE  DEFRESS  SEND  KEY  WHEN  SUBJECT  BEGINS 
TO  PERFORM  TASK  ELEMENT 


Figure  3-16.  Task  initiation  display. 


Immediately  after  the  experimenter  signals  the  system  that  the  sub- 
ject has  begun  performing  the  task  element,  the  message  presented  as  Fig- 
ure 3-17  is  displayed.  The  experimenter  depresses  the  SEND  key  when  he 
observes  that  the  subject  has  completed  the  task. 

PLEASE  DEPRESS  SEND  KEY  WHEN  SUBJECT  HAS 
COMPLETED  THIS  TASK  ELEMENT 


Figure  3-17.  Task  completion  display. 


The  display  shown  in  Figure  3-18  is  presented  to  the  experimenter 
after  the  experimenter  has  signaled  that  the  subject  has  completed  the  task. 
The  experimenter  enters  the  number  of  subject  errors  and  his  evaluation 
of  subject  performance  (success/ failure  indicator). 


PERFORMANCE  TIME  FOR  SUBJECT  = XX.  XX  SECONDS 
ENTER  NUMBER  OF  SUBJECT  ERRORS  -00 
SUCCESS/ FAILURE  INDICATOR  (S/F) 

DEPRESS  SEND  KEY  TO  CONTINUE 

Figure  3-18.  Experimenter  success/failure  indication  display. 
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The  message  shown  in  Figure  3-19  is  displayed  to  the  subject  im- 
mediately after  the  experimenter  enters  a YES  response  to  the  query  on 
whether  or  not  the  subject  is  required  to  enter  a message  on  the  display. 
The  subject  depresses  the  SEND  key  when  he  is  prepared  to  begin. 


| 

j 


THE  NEXT  DISPLAY  WILL  PRESENT  A FORMAT  TO  YOU 
YOU  ARE  TO  ENTER  APPROPRIATE  MESSAGE  ON  THE  CRT 
DEPRESS  SEND  WHEN  YOU  HAVE  COMPLETED  THE  MESSAGE 


Figure  3-19.  Subject  entry  advisory  display. 


A sample  display  of  a TQS  message  format  which  is  presented  to 
the  subject  is  shown  in  Figure  3-20.  The  subject  enters  his  responses  in 
the  appropriate  spaces.  When  he  has  completed  entering  the  message,  he 
depresses  the  SEND  key.  This  enables  the  system  to  time  the  subject. 


UGIC  CON  MEAS  DATA  MESSAGE  OBJECTIVES 


MSG-NR  PREC 

SCTY 

ORIG  RESTR 

( ) 

UNIT-ID-OR-TF-NAME 

) 

OBJ- 1 -NAME 

)TJME{ 

) 

LOC( 

9 

9 9 

9 ’ 

9 

9 

) 

RESP-UNIT< 

) 

OB  J-2  -NAME( 

)TIME( 

) 

LOC( 

9 

* 9 

9 " 

“ ” ~ ~ 9 

9 

) 

RESP-UNIT{ 

) 

OBJ-3-NAME( 

)TIME( 

) 

LOO 

9 

* 9 

9 

9 

9 

) 

RESP-UNIT( 

) 

Figure  3-20. 

Sample  message  format. 
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For  each  incorrect  subject  response,  the  display  shown  in  Figure 
3-21  is  presented  after  the  subject  has  entered  his  responses.  The  incor- 
rect responses  are  displayed  to  both  the  subject  and  experimenter. 

RESPONSE  B IS  IN  ERROR 
SHOULD  BE— 

113000ZJAN73 

SUBJECT  RESPONSE  WAS— 

PLEASE  DEPRESS  SEND  TO  CONTINUE 
Figure  3-21,  Incorrect  response  display. 

A display  is  also  presented  to  the  experimenter  after  all  subject  in- 
correct responses  have  been  displayed.  The  experimenter  enters  his  eval- 
uation (S  or  F for  success/failure  indicator)  and  presses  the  SEND  key.  This 
display  is  shown  in  Figure  3-22. 

PERFORMANCE  TIME  FOR  SUBJECT  = 87.  80  SECONDS 
NUMBER  OF  INCORRECT  RESPONSES  = 7 
ENTER  SUCCESS/FAILURE  INDICATOR  (S/F)  - 
DEPRESS  SEND  KEY  TO  CONTINUE 

Figure  3-22.  Experimenter  evaluation  display. 


Table  3-1  shows  the  new  subroutines  and  programs  added  in  order  to 
accomplish  the  interactive  model. 

Table  3-1 
New  Subroutines 

SUBROUTINE  NAME  FUNCTION  OF  SUBROUTINE 

EXPER  Experimenter  interface  logic 

SUBJEK  Subject  interface  logic 

WDISP  Routes  formats  to  CRT's  and  processes 

operator  responses 

Writes  output  record  to  disc  for  later  print 
Reads  card  images  from  disc  input  file 
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CHAPTER  IV 


EVALUATION  AND  SENSITIVITY  OF  INTERACTIVE  MODEL 
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One  may  reasonably  ask  whether  or  not  an  interactive  simulation 
approach  possesses  any  overall  advantage  when  compared  with  a model 
which  is  confined  to  digital  simulation  methods.  On  the  surface,  it  seems 
that  certain  aspects  of  human  behavior  cannot  be  simulated  with  any  degree 
of  veridicality  through  digital  simulation.  One  reason  for  this  may  be  that 
the  data  base  regarding  certain  aspects  of  human  performance  may  not  be 
adequate.  Another  reason  is  that  behavioral  theory  may  not  be  sufficiently 
developed  to  allow  an  adequate  digital  representation.  In  these  cases,  the 
advantages  of  the  hybrid  approach  are  obvious.  But  what  about  the  more 
general  case? 


Model  Validity 

According  to  Coombs  et  al.,"the  basic  defining  characteristic  of  all 
models  is  the  representation  of  some  aspects  of  the  world  by  a more  abstract 
system.  In  applying  a model,  the  investigator  identifies  objects  and  relations 
in  the  world  with  some  elements  and  relations  in  the  formal  system.  Conse- 
quently, the  model  is  regarded  as  an  abstract  representation  of  the  world 
and  the  modeling  process  is  called  abstraction.  When  the  model  has  been 
constructed,  its  consequences  may  be  derived  using  the  rules  of  logic  and 
the  available  mathematical  machinery"  (1970,  p.  2). 

After  completion  of  model  construction,  the  formal  process  of  veri- 
fication (validation)  can  begin.  Flowing  from  the  application  of  the  model 
are  a set  of  logical  consequences.  These  consequences  are  then  taken,  ac- 
cording to  Coombs  et  al. , as  predictions  to  be  compared  with  data.  This 
stage  of  the  interpretative  process  involves  statistical  assessment  or  veri- 
fication since  it  requires  a determination  of  the  degree  of  correspondence 
between  model  output  and  the  real  world,  as  represented  by  data..  Unfor- 
tunately, according  Birnbaum  (1973),  the  widely  used  statistic  employed  to 
assess  the  degree  of  fit,  a correlation  between  model  predictions  and  data, 
can  be  higher  for  incorrect  models  than  for  correct  models.  Usually,  the 
examination  of  data  from  the  real  world  will  lead  to  modifications  of  the 
model  since  a model  may  contain  a number  of  deficiencies,  i.  e. , it  may 
include  irrelevant  variables,  it  may  exclude  relevant  variables,  possibly 
relevant  variables  may  have  been  evaluated  inaccurately,  and  finally,  the 
relationship  between  controlled  and  uncontrolled  variables  may  be  in  error 
(Ackoff  & Sasieni,  1968). 


1 Figure  1,  adapted  from  Coombs  et  al.  (1970)  and  Obermayer  (1964), 

||  attempts  to  summarize  some  of  the  relations  among  the  various  phases  of 

||  the  modeling  process.  From  a logical  point  of  view,  according  to  Coombs 

et  al.  (1970),  a model  can  only  be  rejected  on  the  basis  of  data,  not  proven. 

H A finding  from  a particular  model  may  also  be  predicted  from  a variety  of 

H other  models.  Therefore,  the  presence  of  predictive  validity  in  a particu- 

H lar  model  only  provides  some  inductive  support  for  the  model.  However, 

through  a combined  convergent  and  discriminant  approach,  an  investigator 
can  intensify  inductive  support  for  a particular  model  (Campbell  & Fiske, 
1959).  While  the  Campbell  and  Fiske  approach  has  been  employed  largely 
in  the  field  of  test  validation,  recent  investiga"  s have  employed  the  meth- 
od with  considerable  success  in  providing  indue  t:  *e  support  for  a digital 
simulation  model  of  a psychosocial  system  (Siegel,  Lautman,  & Wolf,  1972). 
Fortunately,  the  Campbell  and  Fiske  methodology  permits  the  use  of  both 
correlational  arid  variance  analytic  methodologies.  The  combined  methodol- 
ogies provide  considerable  help  in  overcoming  some  of  the  goodness  of  fit 
problems  associated  with  putting  together  and  untangling  the  pieces  of  in- 
formation which  go  into  a model  validation  and  its  subsequent  inductive  sup- 
port vAnderson,  1970,  1971;  Birnbaum,  1973). 


Unfortunately,  none  of  these  approaches  resolve  the  practical  prob- 
lem of  optimizing  the  selection  among  competing  models  designed  for  the 
same  purpose.  Shepard's  (1964)  paper  on  subjectively  optimum  selection 
among  multiattribute  alternatives  presents  a decision  theoretic  approach. 
Application  of  the  Shepard  methodology  to  the  present  problem  will  be  made 
through  an  adaptation  of  a symposium  paper  presented  by  Edwards  (1971). 


Multiattribute  Utility  Scaling 

The  purpose  of  the  Edward's  technique  in  the  present  context  is, 
ultimately,  to  provide  a reasonable  measure  of  the  contribution  of  each 
of  the  modeling  approaches  to  specified  goals.  Involved  in  the  technique 
are  two  independent  stages  of  measurement.  When  the  results  of  these 
two  stages  are  combined,  a utility  value  for  each  of  the  competing  approaches 
is  acquired.  As  such,  the  technique  represents  one  of  several  possible  quan- 
titative approaches  to  the  evaluation  of  utility. 
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Scaling  the  Importance  of  Model  Attributes 


The  first  stage  of  the  measurement  of  utility  requires  a delineation 
of  the  attributes  of  models  to  be  scaled  in  terms  of  their  relative  importance 
to  specified  goals,  e.  g. , prediction,  information,  system  design,  feasibil- 
ity demonstration,  subsystem  comparison,  training,  analysis,  etc.  One  set 
of  model  attributes  might  be; 

construct  validity 

repeatability  of  output 

degree  of  error/low  variability 

feasibility  of  use  and  application 

content  validity/ real  world  detail 

low  confounding  of  variables 

sensitivity/  input-output 

low  number  of  assumptions/parsimony 

generality/ flexibility  of  application 

modifiability 

Other  attribute  listings  relative  to  simulation  models  have  been  de- 
veloped by  Meister  (undated)  and  Siegel  (1970).  Once  the  attributes  have 
been  specified,  they  can  be  assigned  numerical  values  that  represent  their 
relative  importance  for  the  specified  goal  which,  in  the  present  case,  has 
been  left  undefined  since  the  approaches  to  be  evaluated  are  both  assumed 
to  have  been  designed  for  the  same  purpose. 


Rating  the  Attributes  of  Models 

Two  expert  judges  rated  each  of  the  above  listed  model  attributes 
without  reference  to  a specified  goal.  The  procedure  began  with  ranking 
the  attributes  from  most  important  to  least  important.  Then,  the  least  im- 
portant dimension  was  assigned  a value  of  10,  and  the  remaining  nine  at- 
tributes (dimensions  of  value)  were  assigned  values  by  magnitude  estima- 
tion. Alternatively  stated,  numbers  were  assigned  to  develop  a ratio  scale 
based  on  the  anchor  value  of  10  for  the  least  important  attribute.  When  this 
task  was  completed,  the  sum  of  the  numbers  assigned  to  all  ten  attributes 
was  obtained,  and  the  value  assigned  to  each  was  divided  by  this  sum.  In 
this  way,  scale  values  were  converted  into  proportions  of  total  importance 
contributed  by  each  of  the  ten  attributes.  Emerging  from  this  procedure 
was  a set  of  numbers  with  properties  rather  like  probabilities.  The  mag- 
nitude estimations  of  the  two  judges  were  averaged  prior  to  the  computation 
of  proportions. 


Weighting  Models  on  Dimensions  of  Value 

The  second  stage  of  measurement  involved  a determination  of  the 
location  of  each  approach  being  evaluated  on  each  of  the  dimensions  of 
value.  This  measurement  was  accomplished  by  asking  an  appropriate  ex- 
pert to  estimate  for  each  attribute  the  position  of  each  approach  on  a 0-100 
scale  of  plausibility,  alternatively  expressed  as  the  ease  by  which  the  mod- 
el builder  could  achieve  each  desired  dimension  of  value  for  each  model. 
Zero  was  defined  as  the  minimum  plausible  value  and  100  was  defined  as 
the  maximum  plausible  value. 


Combining  the  Stages:  Calculation  of  Utilities 

Calculation  of  the  aggregate  utilities  was  accomplished  in  accord- 
ance with  the  equation  given  by  Edwards: 


?<wiV 


where 


Sw,  = 1. 00 


<wjV 


The  aggregate  utility  for  the  1th  approach  is  represented  by  U;  w is  the 
importance  weight  of  the  j**1  dimension  of  value;  u..  is  the  scaled  position  of 
the  ith  model  on  the  jth  dimension  of  value.  In  words,  the  final  result  of  the 
scaling  procedure  consisted  of  one  aggregate  utility  for  each  approach  eval- 
uated.--interactive  or  completely  digital.  Since  only  two  modeling  approaches 
were  evaluated  in  this  manner,  selection  among  the  competing  models  design- 
ed for  the  same  purpose  may  be  based  on  maximization  of  Uj.  Alternatively 
stated,  the  approach  with  the  highest  aggregate  utility  is  identified  as  more 
desirable  in  general  or  on  the  overall. 


Results 

The  utilities  so  derived  for  each  of  the  two  modeling  approaches  are 
presented  in  Table  4-1.  An  inspection  of  Table  4-1  indicates  a slight  superi- 
ority of  the  completely  digital  over  the  interactive  simulation  approach. 


I 


Table  4-1 


Calculated  Utilities  for  Two  Simulation  Approaches 


Completely 


Dimension  of  Value 

w. 

3 

Interactive 

U. 

l 

Digital 

Ui 

Construct  validity 

.18 

9 

5 

Repeatability  of  output 

. 16 

13 

16 

Degree  of  error/ low  variability 

.14 

4 

7 

Feasibility  of  use  and  application 

.13 

8 

12 

Content  validity/ real  world  detail 

.12 

10 

7 

Low  confounding  of  variables 

.10 

3 

5 

Sensitivity/  input-output 

.08 

5 

6 

Low  number  of  assumptions/ parsimony 

.04 

4 

2 

Generality/ flexibility  of  applicant 

.03 

2 

1 

Modifiability 

.02 

1 

2 

EUj  = Aggregate  utility  = 

59 

63 

Note;  U. 


ij  is  not  presented  in  this  table. 


While  the  completely  digital  approach  showed  a slight  superiority 
over  the  interactive  simulation  approach  in  terms  of  aggregate  utility  across 
all  dimensions  of  value,  there  was  considerable  variation  among  the  approach- 
es when  examined  at  the  level  of  their  utilities  on  individual  dimensions.  The 
intei  active  approach  showed  higher  utility  for  the  dimensions  of  construct 
validity,  content  validity/ real  world  detail,  parsimony/low  number  of  assump- 
tions, and  generality/ flexibility  of  application.  For  all  ether  dimensions,  the 
completely  digital  approach  showed  higher  utility.  The  slight  superiority  of 
the  completely  digital  approach  resulted  largely  because  it  had  higher  utilities 
for  the  attributes  of  models  judged  to  be  more  important,  i,  e. , repeatability 
of  output,  degree  of  error/low  variability,  and  feasibility  of  use  and  applica- 
tion. 


Since  the  present  application  of  Edwards'  approach  left  the  goal  or 
purpose  of  the  approaches  under  consideration  undefined,  the  results  pre- 
sented in  Table  4-1  could  easily  change  with  appropriate  goal  definition. 
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Sensitivity  Tests 


In  order  to  verify  the  acceptability  of  the  program  and  logic  changes 
incorporated  into  the  basic  model  to  produce  the  strengthened  model,  seven 
test  computer  runs  were  made.  The  results  and  implications  of  these  runs 
are  presented  in  this  section,.  The  basic  input  data  for  the  model  were  es- 
sentially the  same  as  those  used  in  the  six  operator  case  described  in  the  pri- 
or report  (Siegel,  Wolf,  & Leahy,  1972);  this  situation  is  called  run  1 or  the 
baseline  run. 

Figure  2-2  shows  the  parametric  input  and  Figure  2-3  contains  the 
task  analytic  data  for  all  seven  runs.  Parameters  varied  in  these  test  runs 
are  those  which  would  be  expected  to  exercise  those  portions  of  the  model 
which  were  enhanced,  to  generate  the  strengthened  model. 

Table  4-2  shows  the  parameters  which  were  modified  during  the  runs; 
operator  precision,  number  of  messages  per  stimulus  message,  message 
frequency  by  priority,  and  operator  speed.  The  results  for  each  condition 
will  be  discussed  independently. 

Precision 

Parameter  values  of  high  operator  precision  (0.  85)  and  low  operator 
precision  (1. 15)  were  run.  The  results  from  these  runs  may  be  compared 
with  the  baseline  (precision  = 1.00)  run  results  (see  Figure  4-2).  The  .-simu- 
lated high  precision  crew  worked  about  12  per  cent  less  time  to  process  the 
same  workload  as  a crew  of  nominal  precision.  However,  an  increase  of 
about  150  per  cent  in  time  worked  was  shown  for  the  very  imprecise  crew. 

This  is  due  to  the  fact  that,  within  the  model,  the  probability  of  task  failure 
approaches  infinity  as  precision  approaches  its  lowest  value  (1.  20).  For  a 
value  of  precision  = 1. 15,  task  failures  are  far  more  frequent  than  successes. 
As  a result,  the  average  time  to  process  a message  jumped  to  2640  seconds 
as  opposed  to  550  seconds  for  the  baseline  runs  and  fell  to  515  seconds  for 
the  high  precision  crew.  Also,  as  expected,  the  average  final  stress  was 
directly  related  to  precision.  A 3 to  1 simulated  stress  change  was  exhibit- 
ed from  low  to  high  precision.  The  simulated  low  precision  group  had  a 
final  stress  of  . 147,  while  the  high  precision  group  had  a final  stress  of 
. 049. 


Figure  4-3  displays  the  four  effectiveness  components  and  the  com- 
posite effectiveness  as  a function  of  simulated  operator  precision.  It  is  ap- 
parent that  precision,  as  simulated,  impacts  simulated  system  effective- 
r.ccc  to  a degree.  The  simulated  high  precision  crew  had  a 

thoroughness  rating  of  . 92.  The  nominal  or  baseline  crew  exhibited  a mini- 
mal reduction  to  . 91,  but  the  thoroughness  of  the  simulated  low  precision 
crew  was  indicated  to  be  .65. 


For  the  completeness  component  of  effectiveness,  the  results  were 
similar  with  the  high  precision  group  receiving  a value  of  . 70,  the  baseline 
group  .65,  and  the  simulated  low  precision  group  dropping  to  .25. 

For  the  responsiveness  component  of  effectiveness,  the  trend  was 
stronger.  The  simulated  high  precision  group  value  was  . 83,  the  average 
group  value  .79,  and  the  low  precision  group  received  a responsiveness 
value  at  .03. 


The  accuracy  effectiveness  component  indicated  the  least  change  as 
a function  of  simulated  operator  precision.  The  low  and  nominal  precision 
simulated  groups  both  indicated  an  accuracy  of  . 49,  while  the  high  precision 
operators  indicated  an  accuracy  of  .55.  However,  we  note  that  quite  low 
undetected  error  probabilities  were  input  and,  as  a result,  the  effects  of 
precision  on  accuracy  are  minimized. 

For  the  overall  or  composite  effectiveness  score,  the  high  precision 
simulated  crew  effectiveness  was  . 73,  the  average  crew  effectiveness  was 
also  .73,  while  the  low  precision  crew  composite  effectiveness  was  . 13. 


Humber  of  Messages  Per  Stimulus  Message 

Run  4 was  made  to  exercise  the  new  model  logic  which  permits  multi- 
ple TOS  input  message  generation  for  each  stimulus  message.  Each  com- 
munication submitted  to  the  action  officer  is  considered  a stimulus  message. 
(Note  that  the  secondarily  generated  messages  are  not  restricted  to  the  origi- 
nal message  type  but  are  given  a type  number  in  the  same  prearranged  pro- 
portion as  any  new  message. ) In  run  4,  three  messages  were  to  be  gener- 
ated (on  the  average)  for  each  type  1 stimulus  message  entering  the  system. 

In  the  baseline  run,  65  type  1 messages  and  a total  of  397  messages  w»  re 
processed.  Thus,  an  additional  2 x 65  = 130  messages  (a  total  of  527)  would 
be  expected  to  be  generated  in  run  4.  The  numbers  of  messages  used  repre- 
sent totals  over  10  iterations.  Actually,  513  were  processed  (as  shown  in  Tab- 
le 4-3)  indicating  acceptable  program  operation  in  view  of  random  effects  dur- 
ing the  10  iteration  runs: 
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Table  4-3 


Results  of 

Message  Generation 

Modification 

Message  Type 

Baseline 

Run  4 

1 

65 

78 

2 

102 

127 

3 

29 

56 

4 

136 

176 

5 

57 

67 

6 

6 

3 

7 

2 

6 

As  a result  of  the  increased  message  load,  time  worked  was  about 
30%  larger  than  the  baseline  run  and  average  final  stress  increased  from 
0.  08  to  0.  12.  Moreover,  the  processing  time  per  message  also  increased 
30  per  cent.  Overall  effectiveness  was  only  insignificantly  affected. 

However,  as  anticipated,  there  was  an  increase  in  time  (140  sec- 
onds as  opposed  to  a baseline  value  of  41  seconds)  for  message  in-queue 
time.  This  effect  was  expected  because  of  the  increased  number  of  mes- 
sages which  arrive  at  the  same  time. 


Effect  of  Message  Priorities 

Run  5 was  completed  to  ensure  that  the  proper  effect  on  stress  was 
achieved  by  relatively  large  numbers  of  high  priority  messages.  A total  of 
394  messages  was  processed  in  run  5.  The  input  probabilities  of  the  five 
types  of  priority  (Table  4-2)  were  .30,  . 10,  . 10,  .20,  . 30.  Accordingly, 
the  expected  number  of  messages  by  priority  is  118,  39,  39,  79,  and  118. 
This  is  acceptably  close  to  the  actual  results;  124,  34,  44,  77,  and  115, 
based  on  the  fact  that  selection  of  a message  priority  is  also  dependent  on 
pseudorandom  processes. 

As  would  be  expected,  little  change  from  nominal  was  evidenced 
in  this  run  in  the  number  of  messages  processed  (897  to  889)  or  in  overall 
effectiveness  (.68  as  compared  with  .86),  but  average  terminal  stress  was 
sharply  higher --increasing  from  0.  08  to  0.  47.  This  result  for  stress  is 
in  the  expected  direction  since  higher  priority  messages  are  anticipated  to 
yield  higher  operator  stress. 
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It  is  noted  that  the  stress  buildup  was  almost  exclusively  on  the 
simulated  G-3  and  AO.  For  these  two  operators,  the  combined  final 
stress  was  0.  82,  whereas  the  value  of  0. 11  resulted  for  the  UIODs. 

Operator  Speed 

The  anticipated  effepts  of  operator  speed  on  time  worked  and  oth- 
er factors  was  noted.  Figure  4-4  shows  the  increase  in  work  time,  stress, 
and  average  time  per  message  unit  and  the  decline  in  effectiveness  as  the 
operator  speed. 

Operator  speed  would  also  be  expected  to  affect  the  responsiveness 
component  of  the  effectiveness  measure.  In  fact,  as  operator  speed  in- 
creased from  the  slow  speed  (1. 15)  to  the  baseline  speed  (1.  0),  and  then  to 
the  fast  speed  (.  85),  responsiveness  increased  from  .67  to  .79  and  to  .86. 


Figure  4-4.  Effect  of  operator  speed  on  overall  effectiveness,  final  stress,  average 
working  time  per  message  unit,  and  average  time  worked. 


CHAPTER  V 


SUMMARY  AND  CONCLUSIONS 


The  present  study  attempted  to  achieve  two  purposes:  (1)  to  extend 
a previously  developed  digital  model  for  simulating  the  acts  and  behaviors 
of  the  operators  in  the  TOS  system,  and  (2)  to  strengthen  the  previously 
developed  model  by  incorporating  a number  of  new  features  and  enhance- 
ments. 

The  extension  involved  modification  of  a previously  developed  com- 
pletely digital  computer  based  simulation  so  as  to  allow  "hybrid"  simula- 
tion in  a man-computer  interactive  manner.  In  this  hybrio  or  interactive 
simulation,  a man  sitting  at  a cathode  ray  tube  terminal  can  be  assigned 
the  performance  of  those  tasks  which  are  best  not  treated  through  digital 
simulation  while  the  computer  simulates  the  performance  of  tasks  which 
digital  simulation  treats  well.  The  simulation  is  termed  hybrid  since  the 
human  can  be  considered  to  be  an  analog  device  which  performs  in  inter- 
action with  the  digital  logic  of  a high  speed  computer.  The  end  result  is 
an  interactive  simulation  which  takes  advantage  of  the  time  compression  of 
the  digital  computer  and  allows  inclusion  of  the  flexibility  of  the  human 
components  in  a man/  machine  system. 

The  prior  model  was  modified,  to  this  end,  in  two  ways.  First,  the 
required  programming  was  completed  to  allow  one  or  more  subjects  to  par- 
ticipate in  a TOS  exercise  by  performing  specific  TOS  tasks.  The  tasks 
to  be  performed  by  the  online  subject  are  prespecified  by  the  person  charged 
with  simulation  conduct  and  can  include  such  tasks  as  cathode  ray  tube  mon- 
itoring, data  entry,  data  comparison,  counting,  verifying,  and  decision 
making.  Second,  the  original  model  was  extended  to  allow  the  experimenter 
to  interact  with  the  program  and  make  online  changes  such  as:  parameter 
modification,  assignments  of  subjects  and  the  tasks  they  perform,  and  char- 
acteristics of  messages  and  message  frequency. 

To  achieve  the  second  purpose  of  the  study,  strengthening  of  the  pre- 
viously developed  digital  simulation  model,  a number  of  model  elaborations 
were  developed  and  programmed.  The  principal  elaborations  included:  (1) 
extension  of  the  number  of  shifts  which  can  be  simulated,  (2)  revision  of 
the  calculation  of  performance  effectiveness,  (3)  extension  to  allow  the  gen- 
eration of  more  than  one  TOS  message  from  a single  system  input  message. 
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(4)  correction  in  the  calculation  of  the  number  of  undetected  errors,  (5) 
modification  of  the  calculation  of  operator  stress  to  allow  consideration 
of  the  effects  of  message  priority  on  stress,  and  (6)  improvement  in  the 
content  and  format  of  the  printed  output. 

The  effects  of  the  modifications  on  the  TOS  simulation  model's 
output  were  tested  through  a set  of  sensitivity  tests.  The  results  sug- 
gested that  the  modifications  produce  reasonable  output  (i.  e. , in  conform- 
ity with  logical  expectation). 

Conclusion 

It  appears  that  either  the  strengthened  or  the  interactive  model  may 
now  be  employed  for  testing  various  approaches  to  the  employment  of  sys- 
tem operators  within  the  TOS  system.  It  is  believed  that  the  simulation 
models  will  yield  results  which  are  sufficiently  sensitive  to  yield  statements 
relative  to  preferred  approaches  among  alternatives,  as  well  as  extent  of 
superiority  from  the  points  of  view  of  the  effectiveness  criteria  built  into 
the  model. 

Finally,  we  note  that  the  model  has  not  been  validated  (in  the  psycho- 
metric sense)  and  that  such  validation  is  possibly  always  warranted. 
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This  appendix  presents  the  information  required  by  the  user  of 
the  strengthened  TOS  simulation  model  in  preparing  his  data  for  the 
computer  and  in  running  the  TOS  model.  Included  are  the  card  input 
formats,  card  sequences,  variables  and  subscript  lists,  and  the  like. 
The  program  is  written  in  the  FORTRAN  XV  language  for  implementation 
or.  the  CDC  3300  digital  computer. 

Principal  Subscripts 

Table  A-l  shows  the  principal  FORTRAN  subscripts  used  for  index- 
ing computer  .dimensioned  variables.  For  each  FORTRAN  subscript,  the 
actual,  variable  name  and  present  maximum  value  is  shown.  Without  com- 
puter program  changes,  the  computer  model  cannot  handle  cases  where 
the  variables  exceed  these  maximum  values.  These  subscripts  are  also 
used  in  some  cases  as  variables  in  their  own  right. 

Also  included  here  are  the  assignments  for  the  5 priority  codes 
(IP),  2 operator  type  codes  (J),  4 effectiveness  components  (NEC),  6 
man  number  assignments  (14),  4 error  type  codes  (IE),  and  7 message 
type  codes  (IT). 
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Table  A-l 

Principal  Model  Subscript  Variabl 

es 

Variable 

Subscript 

FORTRAN 

Maximum 

Value 

Hour  Number 

IH 

15 

Iteration  Number 

NSHF 

100 

Message  Number  (Cumulative) 

CMSG 

200 

Priority  Number 

IP 

5 

1 - routine 
? - priority 

3 - operational  immediate 

4 - flash 

5 - presidential  interrupt 

Task  Element  Number 

I 

20 

Task  Analysis  Number 

K 

4 

Operator  Type 

J 

2 

1 - G3  and  Action  Officer 

2 - IOD 

Effectiveness  Component  Number 

NEC 

4 

1 - thoroughness 

2 - completeness 

3 - responsiveness 

4 - accuracy 

Man  Number 

M 

6 

MEN(l)  : Action  Officers  C G3s 
(G3  is  MEN(l)) 

MEN(2)  : IOD  operators 

Error  Type 

IE 

4 

1 - commission 

2 - typographic  (includes  abbre- 

viation 6 spacing) 

3 - omission 

4 - other 

Me:. -eg-  7ype  IT  8 

1 - vjdd  data 
- change  data 

3 - delete  data 

4 - query 

5 - relay 

6 - special  process  request 

7 - standing  request  for  information 


A-2 
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Maximum 

Value 

FORTRAN 

IHMAX 

NSHIFT 


* 


% 

£ 


■A 


MEN ( 3 ) 


5 


Card  Types  and  Function 

Table  A-2  presents  the  data  and  type  sequence  for  inputing  the 
TOS  simulation  model  computer  program.  There  are  18  card  types.  All 
of  the  first  17  must  be  present  in  the  first  simulation  run  of  a 
series.  After  the  first  run  of  a series,  it  is  not  necessary  to  re- 
peat all  of  the  input  data  for  subsequent  runs,  if  the  previous  in- 
puted  data  can  be  used.  Card  types  3,  6,  9,  11,  14,  and  16  control 
this  option  of  bypassing  the  inputing  of  specific  types  of  informa- 
tion. 

The  order  of  data  cards  within  a run  is  critical.  A single  card 
type  out  of  sequence  will,  at  best,  yield  a faulty  run. 

Table  A-3  presents  the  data  found  on  card  types  1 and  2.  Neither' 
of  these  card  types  may  be  omitted  from  the  input  deck.  Card  type  1 
provides  72  columns  for  a prose  description  of  the  mission  to  be  simu- 
lated. This  prose  description  called  INDENT  will  be  printed  at  the 
top  of  each  page  of  program  output . 

Card  type  2 contaLns  the  simulation  parameters  for  this  computer 
run.  In  this  data  card,  as  in  all  cards,  where  multiple  columns  are 
allocated  (except  for  alphabetic  entries),  the  entry  must  be  right 
justified.  For  example,  on  card  2,  the  first  entry  is  NSHIFT  in  columns 
1 to  3.  If  only  one  iteration  is  desired,  this  entry  must  be  punched 
in  column  3.  If  the  one  is  placed  in  column  2 with  nothing  in  column 
3,  it  will  be  interpreted  as  10.  Preceding  blanks,  on  the  other  hand, 
are  ignored.  Table  A-3  also  describes  the  purpose  of  each  entry. 

The  total  of  MEN(l)  and  MEN(2)  cannot  be  larger  than  6,  within 
present  program  constraints. 

The  output  recording  options  (ORD's)  allow  a flexibility  between 
exact  detailing  of  each  task  element  processing  and  errors  committed 
to  general  run  summaries.  Intermediate  options,  as  shown  in  Table  A-3, 
have  a great  effect  on  printout  time,  and  may,  therefore,  be  bypassed 
when  computer  processing  time  is  limited.  The  run  summaries  are  not 
optional,  but  are  always  printed.  The  run  summaries  include  tables  for 
manpower  utilization  data,  message  processing  trimming,  effectiveness 
data,  workload  summary  data,  and  error  summary  data. 


Order 
(card  type) 


Table  A-2 

Input  Card  Sequence  for  TOS  Simulation  Program 
Description  of  Input  Card  Contents/Function 


Mission  title 

Simulation  parameters 

Read  or  skip  operator  parameters 

Names  of  operators 

Operator  parameters  (one  card  per  operator) 

Read  or  skip  hour  parameters 

Names  of  message  types 

Hour  parameters  (one  card  f-  each  hour) 

Read  or  skip  error  data 

Error  data  (one  card  for  each  of  3 error  types) 

Read  or  skip  message  length  data 

Message  length  means 

Mesage  length  standard  deviations 

Read  or  skip  task  analysis 

Task  analysis  (one  card  for  each  task  element) 
Read  or  skip  effectiveness  components 
Effectiveness  components 
Repeat  for  new  run  or  end 


I 


( 


c 


c 


Table  A -3 


Input — Mission  Identification  and  Simulation  Parameters 


Card 

Mission  Title(card  type  1)  Columns 

IDENT-A  run  descriptor  of  up  to  72  characters  is  printed  on  the  top 

of  each  page  of  printout  followed  by  the  page  number 1-72 

Simulation  Parameters (card  type  2) 


NSHIET-Number  of  repetitions  or  iterations  of  this  mission  before  summary 

data  are  prepared 

IHMAX-Number  of  hours  per  shift  (determines  the  number  of  type  6 cards  to 

be  read ) . . 

MESH  1 )-Number  of  operators  of  type  1,  number  of  action  officers  including 

G-3.  The  highest  numbered  AO  is  the  G-3 

MEN(2)-Number  of  operators  of  type  2,  number  of  input/output  device  (IOD) 
operators.  The  sum  of  MEN(1)+MEN(2)  determines  the  number  of  type  S 

cards  to  be  read  in 

ORO(l)-Output  recording  option  number  1 

If  equal  1 print  input  data 

0R0(2)-0utput  recording  option  number  2 

If  equal  to  1 print  hourly  message  queue 

0F0(3)-Not  used 

ORO(4)-Output  recording  option  4 

If  equal  to  1 print  detail  task  element  processing 

0R0(  5)-0utput  recording  option  5 

If  equal  to  1 print  message  processing 

0R0(6)-0utput  recording  option  6 

If  equal  to  l print  hour  and  iteration  summary 

0R0(7)-Not  used 

0R0(8)-Not  used 

0R0(9)-Not  used 

0R0(10)-Not  used 

IDAY-Day  of  mission  simulated. 

BKLG-Number  of  messages  in  AO/63  inbox  at  the  beginning  of  the  shift 

PUL-Probability  of  a non  important  undetected  error  in  the  central 

computer  complex  data  store 

PUS-Probability  of  a significant  error  in  the  central  computer  complex 

data  store 

SRTA-System  response  time  to  an  inquiry 

SRTS-Standard  deviation  of  the  system  response  time  to  an  inquiry 

IATA(1,1)-Task  analysis  to  be  used  for  operator  type  1 message  type  1 

IATA(1,2)-Same  as  above  but  for  message  type  2 

IATA(1,3)-Sam ; as  above  but  for  message  type  3... 

IATA(1,4)-Same  as  above  but  for  message  type  4 

IATA(1,5)-Same  as  above  but  for  message  type  5 

IATA(1,6)-Same  as  above  but  for  message  type  6 

IATA(1,7)-Same  as  above  but  for  message  type  7 

IATA(1 ,8)-Same  as  above  but  for  message  type  8 

IATA(2,l)-0perator  type  2,  message  type  

IATA(2,2)-0perator  type  2,  message  type  2.... 

IATA(2,3)-0perator  type  2,  message  type  3 

IATA(2,4)-0perator  type  2,  message  type  4 

IATA(2,5)-0perator  type  2,  message  type  5 

IATA(2,6)-0perator  t„. pe  2,  message  type  

IATA(2,7)-0perator  type  2,  message  type  7 

IATA(2,8)-0perator  type  2,  message  type  8. 

NTE-Number  of  task  elements  over  all  task  analyses  to  be  used  (determines 

the  number  of  type  15  cards  to  be  r»ad  in) 

Y-Random  number  to  be  used  to  initialize  random  number  generator.  An  eight 

digit  positive  odd  octal  number  must  Oe  used 

ICHAIN-Shift  number  for  this  run  if  chaining  option  is  being  utilized 

(ICHAIN=1  for  first  shift,0  if  no  chaining) 

TZERO-Time  at  start  of  shift  being  simulated 
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4-5 


6 


7 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21-22 

25-29 

30-34 

35-39 

40-44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61-63 


65-71 


76 

77-80 
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The  variable  1DAY  determines  the  day  number  of  a simulation  with 
rei crencp  to  the  number  of  continuous  days  worked  at  this  task  and  is 
used  within  the  model  to  trigger  fatigue  effects. 

The  variable  matrix  IATA  determines  which  task  analysis  (i.e., 
procedure)  will  be  used  in  the  processing  of  a message.  It  is  present- 
ly limited  to  a maximum  of  four  task  analyses.  None  of  these  may  have 
more  than  20  tas'i  elements. 

Table  A -4  shows  the  card  formats  for  card  types  3,4,  and  5.  Card 
type  3 determines  whether  or  not  new  operator  description  data  will  be 
read  in.  Card  type  4 specifies  the  four  character  names  of  the  known 
operators  (i.e.,  UI0D,  etc.).  One  card  type  5 is  required  to  describe 
each  of  the  operators  called  for  on  card  type  2.  Since  the  man  number 
is  on  each  card,  ordering  of  these  cards  is  not  required. 

Table  A-5  describes  the  data  for  card  types  6,  7,  and  8.  Card 
type  6 determines  whether  or  not  new  hour  parameters  will  be  read.  Card 
type  7 provides  for  the  readin  of  names  for  each  of  seven  message 
types.  Each  name  consists  of  four  characters.  This  name  will  be  print- 
ed out  in  detailed  message  processing  if  this  option  is  called.  For 
every  hour  to  be  simulated,  on  card  of  type  8 must  appear.  The  hour 
parameters  include  message  workload,  message  type  frequency,  message 
priority  distribution,  and  message  frequency  of  arrival.  The  type  8 
cards  need  not  be  ordered  since  the  hour  is  specified  on  Gach  card. 

Table  A-6  shows  the  card  formats  for  card  types  9 and  10.  Card 
type  9 determines  whether  or  not  error  data  (i.e.,  card  type  10)  is 
read  in  or  not.  Card  type  10  contains  the  error  rate  data  for  each 
message  type  of  each  error  type.  Error  originator  probabilities  are 
also  shown.  Card  types  10  do  not  have  to  be  in  order  of  error  since 
error  type  is  specified  on  each  card. 

Table  A-7  shows  the  format  for  card  types  11,  12,  and  13.  Card 
type  11  determines  whether  or  not  message  length  data  (i.e.,  card  types 
12  and  13)  will  be  read  in  or  not.  Card  type  12  contains  the  mean  mes- 
sage length  data  for  each  message  type.  Card  type  13  contains  the  mes- 
sage length  deviation  data  for  each  message  type. 

Table  A-8  shows  the  card  formats  for  card  types  14  and  15.  Card 
type  14  determines  whether  or  not  task  analytic  data  (i.e.,  card  type 
15)  will  be  read  in  or  not.  One  card  type  15  must  he  input  for  each 
task  element  in  the  task  analysis,  as  specified  by  NTE  in  card  type  2. 
The  card  type  15  contains  all  timing  and  sequencing  data  required  to 
simulate  a task  element . 


jm 


Table  A-4 

Input — Operator  Parameters 


Road  or  skip  operator  parameters (card  type  3) 

ISKIP-  If  equal  to  1 skip  to  reading  card  type  6,  If  not 
equal  to  1 read  card  types  4 and  5 . 


Card 

Column: 


Names  of  operators (card  type  4).  Reads  in  one  four  character  name  for 
each  of  the  men  specified  in  card  type  2. 


NAME(l)-  Name  of  operator  number  1. 

NAME(2)~  Name  of  operator  two 

NAME(M)-  Name  of  operator  M 


Operator  parameters (card  type  5).  One  card  is  read  in  for  each  man 
specified  in  card  type  2. 


M-  Man  number 

F(M)~  The  speed  factor  of  this  man.  An  average  man  is  1.0, 
a faster  than  average  man  has  an  F(M)  value  less  than 
1.0.  A slower  than  average  man  has  an  F(M)  value 

greater  than  1.0 

PREC(M)-  The  precision  factor  of  this  man.  An  average  man  who 

makes  an  average  number  of  errors  would  have  a precision 
factor  of  1.0.  A highly  precise  man  who  makes  many  fewer 
than  average  errors  would  have  a precision  factor  of  0.9. 
Perfection  is  represented  by  a value  of  0.8  and  complete 
failure  which  would  result  in  unending  runs  is  represented 

by  a value  of  1.2 

STRM(M)-  The  stress  threshold  of  this  man.  The  number  of  priority 
messages  in  the  backlog  for  this  man  which  will  produce 

a maximum  effort 

ASP(M)-  The  level  of  aspiration  of  this  man.  An  aspiration  of 

1.0  represents  striving  for  perfection 


10-14 


15-19 


20-24 
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Table  A-5 

Input — Hour  Parameters 


Card 

Column-; 


Road  or  skip  hour  parameters (card  type  6) 


1SKIP-  If  equal  to  1 skip  card  type  9, 

If  not  equal  to  1,  read  card  types  7 and  8. 


Names  of  message  types (card  type  7) 

NMTYP(1)-Name  of  message  type  1 1-4 

NMTYP(2)-Name  of  message  type  2 5-8 

NMTYP(3)-Name  of  message  type  3 9-1° 

NMTYF(4)-lIame  of  message  type  4 , , . 13-1G 

NMTYP(5)-Natne  of  message  type  5 17-20 

NMTYP(6)-Name  of  message  type  6 21-24 

NMTYP(7)-Name  of  message  type  7 25-28 

Hour  parameters (card  type  8) 

One  card  for  each  hour  specified  in  card  type  2 by  IHMAX. 

IH-Hour  number 1-2 

IGP(IH)-Number  of  messages  arriving  in  A0/G3's  inbox  in  the  last  15 

minutes  of  this  hour . 3-4 

IGR(IH)-Number  of  messages  arriving  in  A0/G3 ’ s inbox  randomly  through- 
out this  hour 5-6 

IUR(IH)-Non  functional. 7^8 

FRET(1,IH)-Cumulative  proportional  occurrence  of  message  type  1 - add 10-14 

FRET(2,IH)-Type  2-change 15-19 

FRET(3,IH)-Type  3-delete 20-24 

FRET ( 4, IH) -Type  4-query 25-29 

FRET(5,IH)-Type  5-relay 30-34 

FRET (.6 , IH) -Type  6-SPR 35-39 

FRET(7,IH)-Type  7 -SRI 40-44 

FREP(1,IH)-Cumulative  proportion  of  message  occurrence  of  priority  type  1- 

routine 45-49 

FREP(2,IH)-Priority  type  2-priority 50-54 

FR£P(3,IH)-Priority  type  3-operational  immediate 55-59 

FREP ( 4, IH) -Priority  type  4-flash....- 60-64 

FREP(5,IH)-Priority  type  5-presidential  interrupt 65-69 

FRER(  IH)-Frequency  of  routine  message  arrival  per  hour 70-74 

FREO(IH) -Frequency  of  arrival  of  other  than  routine  messages  per  hour 75-79 

Messages  per  stimulus  data(card  type  7.5) 

RMPS(1)-Number  of  messages  expected  per  stimulus  for  message  type  1 1-5 

RMPS(2)-Number  of  messages  expected  par  stimulus  for  message  type  2 6-10 

RPMS(3)-Number  of  messages  expected  per  stimulus  for  message  type  3 11-15 

RPMS(4)-Number  of  messages  expected  per  stimulus  for  message  type  4 16-20 

RPMS(5)-Number  of  messages  expected  per  stimulus  for  message  type  5 21-25 

RPMS(6)-Number  of  messages  expected  per  stimulus  for  message  type  6 26-30 

RPMS( 7 )-Number  of  messages  expected  per  stimulus  for  message  type  7 31-35 


Table  A-6 


Input — Error  Data 


Card 

Columns 

Read  or  skip  error  data(card  type  9) 

ISKIP-  If  equal  to  1 skip  to  card  type  11, 

If  not  equal  to  1,  read  card  type  10 1 

Error  data (card  type  10) 

IE-  Type  of  error.  l=commission,2=abbreviation,  typographical  or 

spacing,  1 

LR(IE,1  )-Error  rate  per  100  characters  of  message  type  1 ? ° 

ER(IE,2)-Message  type  10-17 

ER( IE , 3 )-Message  type  3 18-25 

ER(IE,4)-Message  type  4 26-33 

ER(IE,5)-Message  type  34-41 

ER( IE,6)-Message  type  6 42-49 

ER(IE,7 )-Message  type  7 50-57 

ER(IE,8)-Non  functional 58-65 

ERPG-Percentage  of  G3/A0  errors  which  produce  error  routines 66-72 

ERPI-Percentage  of  VIOD  errors  which  produce  error  routines 73-79 


Table  A-7 

Input — Message  Length  Data 


Read  or  skip  message  length  data(card  type  11) 

ISKIP- If  equal  to  1,  skip  card  type  14 

If  not  equal  to  1,  read  card  types  12  and  13 

Read  message  length  means (card  type  12) 

INC(1)-Number  of  characters  in  transformed  message  type  1. 


Card 

Columns 


INC(2)-Message  type  20-29 

INC(3)-Message  type  3 30-39 

INC(4)-Message  type  40-49 

INC(5)-Message  type  50-59 

INC(6)-Message  type  60-69 

INC(7)-Message  type  7 • 70-79 

INC(8)-Non  functional 


Read  message  length  standard  deviations(card  type  13) 


INS(1)-Standard  deviation  of  characters  in  transformed  message  type  1 1-9 

INS(2)-Message  type  

INS(  3)-Message  type  3 -u  t* 

INS(4)-Message  type  4 * 

INS(5)-Message  type  r 

INS(6)-Message  type  ^ 

INS(7)-liessage  type  7 70-7  9 

INS(8)-!ion  functional 
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Table  A-8 


Input — Task  Analytic  Data 


Card 

Columns 


Head  or  skip  task  analysis(card  type  14) 


ISKTP- 


If  equal  to  1,  skip  card  type  16...... 

If  not  equal  to  1,  read  card  type  15. 


lask  analysis(card  type  15) 

One  card  for  each  task  element  specified  by  NTE  in  card  type  2. 


K- 

I- 

JTVPE(I,K)- 


CRIT(I,K)- 

m 

1 

ENDd,K)- 

IJF( I ,K)- 

L. 

gjs 

IJS(I,K)- 

p 

AYGTM(I.K)- 

SIGMA(I.K)- 

I 

AVPROB(I.K)- 

1 

UETYPE(I.K)- 

UEP(I,K) 

Task  analysis  number 1-2 

Task  element  number  within  this  task  analysis 3-5 

Task  element  type  where  l=a  task  element  on  which  the  message  may 
be  rejected  with  a probability  specified  by  AVPR0B(I,K),  2-a  task 
element  in  which  the  number  of  -.haracters  for  this  message  type 
will  be  multiplied  times  the  sc ochastically  determined  mean  time 
to  produce  the  time  required  to  transform  the  message,  3=  a decision 
task  element  where  operator  factors  such  as  speed  [F(M)J,  precision 
[PREC{M)],  and  stress  level  [STR(M)]  are  not  allowed  to  affect  the 
duration  or  success  probability  of  the  task  element,  4=  an  equipment 
task  element  where  operator  factors  are  not  considered  and  the  task 
cannot  be  failed,  5=  not  used,  6=  8 special  type  of  branch  task 
element  where  either  a '’COR*'  or  "ERR”  respond  2 is  expected 7 
Criticality  of  the  task  element.  C=critical,  not  C is  not 

critical 8 

Message  processing  segment  ended  by  this  task  element , if  any 10 

The  number  of  the  task  element  which  will  follow  this  one  if 

this  task  element  is  a failure....... 12-14 

The  number  of  the  task  element  which  will  follow  this  one  if 

this  task  element  is  a success 15-17 

Task  element  mean  performance  time 20-29 

Standard  deviation  of  AVG7M(I,K) 30-39 

Task  element  success  probability,  the  probability  that  the 
following  task  will  be  IJS(I,K)  and  not  IJF.  Also  the 

probability  of  message  rejection  when  JTYPEd  ,K)=1. . . , 40-49 

Undetected  error  type  T=transform,  not  T=all  others 50 

Undetected  error  probability. .51-56 
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Table  A-9  shows  the  card  formats  and  contents  of  card  types  16, 
17,  and  18.  Card  type  16  determines  whether  or  not  new  effectiveness 
component  data  (i.e.,  card  type  17)  will  be  read  in  or  not.  Card  typo 
17  contains  the  correlations  among  effectiveness  components,  as  well 
as  the  relative  weight  of  each  component  in  the  computation  of  overall 
effectiveness  (see  Appendix  C). 

Card  type  18  determines  whether  or  not  a new  run  should  be  set 
up.  It  thereby  determines  whether  or  not  a card  type  1 will  be  read, 
thus  cycling  through  cards  1-17  again. 


Table  A-9 

Input — Effectiveness  Component  Data 

Card 

Colum 

Read  or  skip  effectiveness  components  (card  type  16) 


ISKIP-  If  equal  to  1 skip  to  read  card  type  18.  If  not 

equal  to  1 read  card  type  17..., 1 

Effectiveness  components  (card  type  17) 

CC12-  Correlation  between  thoroughness  and  completeness 1-4 

CC13-  Correlation  between  thoroughness  and  responsiveness 5-9 

CC14-  Correlation  between  thoroughness  and  accuracy 10-14 

CC23-  Correlation  between  completeness  and  responsiveness 15-19 

CC24-  Correlation  between  completeness  and  accuracy 20-24 

CC34-  Correlation  between  responsiveness  and  accuracy 25-29 

W(l)-  Relative  weight  of  thoroughness  in  computing 

overall  effectiveness 30-34 

W(2)-  Weight  of  completeness 35-39 

W(3)-  Weight  of  responsiveness.. 40-44 

W(4)~  Weight  of  accuracy 45-49 


The  weights  must  sum  1.0 

Repeat  for  new  run  (card  type  18) 

IREP-  If  equal  to  1,  read  card  type  1.  If  not  equal  to  1 
terminate  program 


Glossary 

Table  A-10  presents  a glossary  of  FORTRAN  variable  names.  This  glossary 
includes  all  variables  except  those  already  defined  in  Tables  A-l  through  A-9.  Table 
A-10  is  partitioned  into  dimensioned  variables.  (i.e.»  variables  which  are  actually  a 
matrix  of  related  variables)  and  nondimens ioned  variables. 


Table  A-10 

Glossary  of  Principal  FORTRAN  Variable  Names 


Dimensioned  Variables 


Z(M) 

TW(IH,M) 

NOSUC(M) 

NOFAIL(M) 

EC(NEC) 

PERF(M) 

AVAIL(I)l 

IDI(IH,M) 

INFOLS(CMSG) 

PASP(H) 

INTRPT(M) 
MSGIRP(M) 
MESS ( LA, J) 
STR(M) 
OUT(MSG,J) 


ISTKNT(l-5) 


Current  time  last  worked 
Total  hours  worked  in  a shift 
Number  of  successes  for  man  M 
Number  of  failures  for  man  M 
Value  of  effectiveness  component 
Performance  of  man  M 

Availibility  indicator  for  man  M;  l=available ; 0=not  available 

Idle  time  for  man  M 

Information  loss  for  this  message 

Permanent  aspiration  level  (necessary  because  aspiration  level 
may  change  within  a given  iteration) 

Set  to  1 if  this  man  has  an  interrupted  message 
Message  number  of  interrupted  message,  this  man 
Messages;  LA=1  total  for  hour;  LA=2  to  do  this  hour,  in  queue 
Operator  stress 
Outcome  for  this  message 
Cc  Complete 
1=  Interrupted 
R=  Rejected 

Blank=  Ready  for  processing  if  it  has  arrived 
Weights  used  in  computing  operator  stress  based  on  message 
priority 
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Table  A-10  (Cont.) 

Nondlmensioned  Variables 

Number  of  message  being  processed 

Number  of  messages  arrived  with  priority  greater  than  1 
Length  of  workday  (hours) 

Number  of  next  message  to "be  processed 
Start  time  for  message  processing 
Pseudo  random  number  equiprobable  in  0-1  internal 
Pseudo  random  (random  deviate),  mean=0,  sigma=l 
Current  iteration  number 
Number  of  iterations  to  be  performed 
Stress  factor 

Execution  time  of  a task  element 
Stress  function  for  execution  time 
Basic  execution  time  function 
IH  minus  1 in  seconds 

Total  number  of  undetected  errors  in  a messsage 
Success  or  failure  indicator 
Efficiency 

Pace  Adjustment  Factor  due  to  aspiration 
Pace  Adjustment  Factor  due  to  work  fatigue 
Temporary  for  task  element  probability,  adjusted 
Cumulative  message  number 

Number  of  messages  interrupted  from  previous  hour 
Cummulative  queue  time  for  all  messages  in  an  hour 
Cummulative  handling  time  for  all  messages  in  an  hour 

Time  Segments 

SEGS(CMSG,1)  TARIV(MSG,l)=time  arrive  in  A0/G3  queue 
SEGS(CMSG,2)  Z(M)  at  PROC  stort=time  of  message  start 
SEGS(CMSG,3)  Z(M)  at  PROC  task  elelement  triggered=select  format 
SEGS(CMSG,4)  TARIV(MSG ,2)=tirae  arrive  IOD  queue 
SEGS(CMSG,5)  Z(M)  t-e  triggered=I0D  request  format 
SEGS(CMSG,6)  Z(M)  t-e  triggered=I0D  send  message 
SEGS(CMSG,7)  Z(M)  end  of  PROC  triggered=IOD  finished  with  message 


MSGNO 

NOMSGS 

IHMAX 

MSG 

ST 

RY 

RD 

NSFT 

NSHIFT 

SF 

TIME 

ZIF 

V 

ZIH 

TNUE 

SIF 

EFF 

PAFA 

PAFW 

PROB 

CMSG 

KINKS 

AQT 

AHT 


Subroutines 

Table  A-ll  presents  the  names  and  functions  of  each  subroutine  of  the  computer 
simulation  program.  The  first  routine  -SIPS  - is  actually  the  main  routine  which  then 
calls  the  subroutines  as  appropriate.  This  fragmentation  of  the  program  into  many  sub- 
routines allows  the  program  to  be  modified  more  easily. 
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Table  A-ll 


Functions 


Kout ine 

Mnemonic 

SIPS 

Simulation  of  Information 

SI  (IP AM 

Processing  Systems 

Simulation  Parameters 

PEOPLE 

- 

LOUR 

ERROR 

- 

RESET 

- 

BAKL0G 

backlog 

MESGEN 

message  generator 

HANDET 

man  determination 

RESHR 

reset  for  hour 

XTSUM 

iteration  summary 

RUNSUM 

run  summary 

PROC 

processing 

RAND 

random  numbers 

INPOA 

inverse  normal  probability 

FATIGU 

fatigue 

ASPIRE 

aspiration 

POIS 

POISSON 

DUMPY 1 

dump-one 

DUMPY2 

dump-two 

CHAIN IT 

chain  initialization 

TOT  IT 

Totals 
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Function 
Main  control  program 


Read  simu'ation  parameters 


Read/generate  personnel 
characteristics 


Read  input  given  by  hour 
Read  error  rate  data 


Prepare  conditions  for  start 
of  new  shift 


Determine  G-3  message  queue 
characteristics 


Generate  message  queues 


Selects  a man  and  a message 
to  simulate  next 


Prepare  conditions  for  new  hour 


Print  results  of  simulating  each 
iteration  of  a shift 


Print  summary  of  ITER  iterations 
and  accumulative  totals  for 
summary  of  all  shifts  when  changing 
option  is  utilized 


Simulation  for  a message 
Generate  p3eudo  random  no.  0-1 


Generate  pseudo  random  no.  normal 
distribution 


Calculate  work  fatigue 
Calculate  aspiration 


Random  number  from  poisson 
distribution 


Entry  point  to  RUNSUM  which  pro- 
vides dumping  of  message  queue 
to  disc  file  at  end  of  a shift 
for  each  ITER  iterations 


Same  as  DUM  (1  for  "from-disc" 
case 


Entry  point  to  RUNSUM  which 
provides  initialization  of 
summation  arrays  for  changing 
option 


Entry  point  to  RUNSUM  which 
provides  computation  and  display 
of  summary  data  over  all  shifts 
for  changing  option 
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This  manual  presents  the  implementation  of  the  experimenter 
and  subject  interface  to  the  TOS  mo'del.  The  manual  includes  a 
program  narrative,  complete  input  and  deck  set-up  instructions, 
variable  j.ists,  flow  charts,  and  user's  instructions.  The  manual 
is  written  with  the  assumption  the  reader  is  familiar  with  the 
original  model  developed  by  Applied  Psychological  Services,  (Siegel, 
Wolf  & Leahy,  1972)  and  jts  strenghtened  version. 


m-- 
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Program  Narrative 


The  experimenter  interface  logic  is  contained  in  a subroutine 
called  EXPER.  EXPER  is  entered  at  the  completion  of  a run  if  the 
experimenter  option  has  been  selected  (EXIN=1).  In  EXPER,  all  dis- 
plays are  routed  to  the  experimenter's  screen. 

First,  the  experimenter  optionally  views  a summary  of  the 
simulation  run  just  completed.  He  can  then  terminate  the  program, 
continue  the  program  with  input  for  the  next  run  coming  from  the 
input  files,  or  be  can  provide  input  parameters  at  his  screen.  If 
the  experimenter  selects  the  experimenter  input  option,  he  receives 
a display  which  names  groups  of  input  variables  for  which  he  can 
provide  new  values. 

After  he  selects  an  input  group,  he  views  the  current  values 
of  each  of  the  input  variables  in  that  group.  He  replaces,  on  the 
screen,  the  current  value  he  wants  in  effect  for  the  next  run. 

EXPER  allows  the  user  to  verify  the  new  input  value  and  to  make 
corrections,  if  necessary.  Then  the  program  returns  to  the  step  at 
which  the  input  groups  are  displayed.  The  experimenter  input  cycle 
continues  until  the  experimenter  selects  no  input  group.  At  this 
time  control  is  returned  to  the  simulation  for  another  run  with  the 
modified  input  parameters. 

As  an  independent  subroutine,  EXPER  does  not  modify  the  simula- 
tion or  affect  any  of  the  printed  output  which  can  be  obtained  after 
the  experimenter  terminates  program  execution. 

The  subject  interface  logic  includes  several  strengthened  TOS 
model  subroutines.  If  the  subject  interface  option  has  been  selected 
(SBIN=1),  the  experimenter  assigns  subjects  to  the  CDC  3300  display 
terminals  before  the  simulation.  If  no  one  is  assigned  to  a display 
terminal,  thee  no  subject  interface  will  occur. 


■ if 


If  at  least  one  subject  has  been  assignee1  to  a display 
tei'minal,  then  the  experimenter  indicates  which  task  analytic 
elements  are  to  be  performed  by  the  subject  and  which  elements 
are  to  be  simulated  by  the  model.  * 

In  the  MESGEN  subroutine,  at  the  beginning  of  each  hour,  an 
action  officer  message  quene  is  built.  This  quene  is  displayed 
to  the  experimenter  and  he  indicates  which  of  the  messages  are  to 
be  replaced  by  messages  which  were  prepared  beforehand.  The  mes- 
sages prepared  beforehand  are  coded  on  computer  cards  and  entered 
into  the  simulation  in  the  input  subroutines. 

In  the  PROC  subroutine,  the  man  and  the  messages  being  pro- 
cessed are  considered  for  subject  processing.  The  following  condi- 
tions must  be  satisfied  for  the  subject  to  perform: 


•The  task  analytic  element  under  consideration 
must  have  been  assigned  a v-lue  of  "P"  in  the 
TA3KPS  array. 

•The  man  processing  the  message  must  have  been 
assigned  a CRT  number  in  the  CONSOL  array. 

•The  message  being  processed  must  have  been 
assigned  a prestored  message  number  in  the  FMT 
array . 


If  all  the  conditions  are  satisfied,  then  the  experimenter 
indicates  on  his  display  whether  or  not  the  subject  is  to  perform. 

The  SUBJEK  subroutine  monitors  subject  performance. 

Two  types  of  subject  monitoring  are  permitted.  In  one  case, 
the  subject’s  performance  is  observed  by  the  experimenter  who  signals 
the  computer  program  when  the  subject  begins  and  ends  the  assigned 
task  analytic  element.  The  computer  program  computes  subject  perform- 
ance time  and  accepts  from  the  experimenter  the  number  of  subject 
errors  and  a success/ failure  indicator  for  the  task.  These  variables 
are  processed  by  the  program  as  though  they  resulted  from  the  actual 
simulation  and  the  simulation  continues. 

The  second  type  of  subject  monitoring  involves  the  subject 
entering  a message  at  his  terminal.  A TOS  format  which  is  associated 
with  the  prestored  message  being  processed  is  displayed  at  the  sub- 
ject's station.  The  subject  enters  his  responses  and  signals  the 


1 


computer  program  when  he  has  completed  his  task.  The  computer 
program  computes  subject  performance  time  and  the  number  of  in- 
correct responses.  The  experimenter  enters  the  task  success/failure 
indicator.  Processing  continues  as  in  case  described  above. 


Supporting  Subroutines 


WDISP  is  a FORTRAN  coded  subroutine  which  controls  all  input/out- 
put processing  for  the  CRT  displays.  The  CLOCK  function  is  utilized 
to  compute  processing  time  for  subject  performance  and  also  to  ter- 
minate the  program  if  no  response  is  received  from  the  experimenter 
within  six  minutes  from  the  time  that  he  receives  a new  display. 

WDISP  also  facilitates  the  hardcopy  option,  dumping  screen  images  to 
the  output  file  for  later  printing. 


DSOUT  is  a FORTRAN  coded  subroutine  which  writes  print  line 
images  to  the  output  file  on  disc.  Up  to  20  line  images  can  be 
written  to  the  disc  in  a single  call  to  DSOUT.  DSOUT  utilizes  the 
RANWRITE  subroutine  for  background  processing. 


DSIN  is  a FORTRAN  coded  subroutine  that  reads  80  character 
records  (card  images)  from  the  disc  input  file.  DSIN  itilizes  the 
RANREAD  subroutine  for  background  processing. 


Computer  Program  Variables 


The  following  dimensioned  variables  are  introduced  by  the 
experimenter/subject  interface  logic. 


CONSOL  (6) 

EXASP  (6) 
EXTMP  (6) 

EXASPH  (12,6) 

EXTPM  (12,6) 

EXPR  (2) 

FTN  (50) 

I BUFF  (250) 

LL  (20) 

RMESS  (3,15) 
RMESS  (1,15) 

RMESS  (3,15) 

RMESS  (2,15) 


CRT  cumber  of  each  man  who  is  to  be 
replaced  by  a subject. 

Aspiration  at  end  of  run  for  each  man. 

Average  time  to  process  a message  (in 
seconds)  for  each  man. 

Aspiration  at  end  of  each  hour  for  each 
man. 

Average  time  xo  process  a message  for  each 
hour  for  each  man. 

First  element  is  average  completion  time 
per  message  for  a run;  second  element  is 
effectiveness. 

Prestored  message  number  for  each  message 
to  be  processed  by  a subject  in  the  simula- 
tion. 

Buffer  containing  space  for  1000  characters 
to  be  displayed  on  a CRT  or  to  be  read  from 
a CRT. 

A utility  array  used  in  several  subroutines. 

Pointer  to  first  input  record  (on  disc)  for 
corresponding  ",'0S  format  for  each  prestored 
message. 

Pointer  to  second  input  record  (on  disc)  for 
each  prestored  message. 

The  number  of  responses  for  each  px-estored 
message. 
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The  following  variables  are  introduced  by  the  experimenter/ 
subject  interface  logic. 


EXIN 

IGTO 


J3LKI 

IBLKO 

1SCRN 

KKK 

TASKPS  (4,20) 

IOUTJB  (680) 

IEORMZ  (300) 


Experimenter  interface  indicator  input  by 
user.  If  1,  then  interface  will  be  exercised; 
if  0,  no. 

Control  indicator  set  by  WDISP  and  EXPER  sub- 
routines. If  1,  then  control  is  to  return  to 
normal  input  processing  after  experimenter 
interface;  if  2,  then  experimenter  has  provided 
input  for  next  run;  if  3,  then  run  is  to  be 
terminated  because  experimenter  has  chosen  to 
end  experiment  or  because  experimenter  has  failed 
to  respond  to  a message  on  the  CRT  within  six 
minutes. 

Input  file  record  pointer.  Integer  value  points 
to  current  input  record  (one  record  is  one  card 
in  the  input  data  deck). 

Output  file  x*€  cord  pointer.  Integer  points  to 
current  output  record  (one  record  is  one  print 
line). 

Screen  number  for  the  experimenter.  Integer 
value  from  1 to  6 provided  input  data. 

Indicator  for  WDISP  subroutine.  Initialized  at 
0 ar.d  set  to  1 at  first  entry  to  WDISP.  If  1, 
su trout iue  calls  CLOCK  subroutine  to  test  re- 
sponse time  of  experimenter;  if  0,  the  WAIT  sub- 
routine is  called  to  initialize  interrupt  pro- 
cessing by  the  operating  system. 

Indicator  for  each  task  analysis  element.  If  "P", 
the  task  element  is  to  be  performed  by  subject; 
if  "S",  the  task  element  is  to  be  simulated. 

Buffer  to  hold  print  line  images  to  be  written 
to  output  file  and  card  images  read  from  input 
line. 

Array  to  hold  T0S  formats  to  be  displayed  on  CRT. 
Capacity  15  cards  for  each  format. 


. * V 


RM2  (35) 


RM1  (35) 


Array  of  35  characters  to  hold  a message 
response  from  the  subject. 

Array  of  35  characters  to  hold  correct 
response  for  a prestored  message. 


UENSP 


Indicator  for  0VRLY3  subroutine.  If  1,  RESET 
and  BACKLOG  subroutines  are  called  upon  entry 
to  0VRLY3;  of  2,  ITSUM  and  BACKLOG  are  called 
if  the  run  is  not  complete;  if  2 and  the  run 
is  complete,  then  ITSUM  and  RUNSUM  are  called; 
if  3,  RUNSUM  is  called. 

Counter  for  a number  of  men  to  be  replaced  by 
subjects  in  tl  2 simulation. 


•r 


Indicator  used  in  0VRLY1  and  input  subroutines. 

If  then  data  are  read  from  input  file;  if 

not  **,'  the:.  NCC  will  be  total  number  of  messages 
processed  for  a run.  In  the  latter  case,  NCC  is 
displayed  for  the  experimenter  and  indicates  that 
no  additional  data  are  to  be  read  from  the  input 
file. 


SBIN 


Subject  interface  indicator  input  by  user.  If  1, 
then  subject  interface  logic  will  be  exercised; 
if  0,  no. 


Number  of  responses  for  prestored  message  being 
processed. 


NWRG 


Counter  for  number  of  incorrect  responses  from 
subject. 


w Y 
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Output  from  the  execution  of  this  program  is  a listing  of  the 
input  data  cards  and  the  input  data  file  on  disc  for  use  by 

This  interactive  program  includes  the  original  TOSS  program 
with  “ee^rimenter  and  subject  interface  logic  incorpora  ted.  The 
program  is  executed  in  background  mode.  The  desk  setup 

7BACK,  ND,  CS-A-18 , *NAME* , 115 
9 

7FET,  TEMP,  SCRATCH1 , , , 

9 

^MODIFY,,,  NEWFET 
9 

7FET,  TEMP,  SCRATCH1,  256 
9 

gOPEN,  25 

7FET,  APS-SIM,  APS-SIM-BCD-INP,  256,,, 
gOPEN,  1 

7FET,  APS-SIM,  AFS-SIMr BCD-OUT,  256,,, 

9 

7OPEN,  2 


r 

OBJECT  DECKS  FOR 
DEMON,  WDISP,  DSOUT , DSINP  AND 
SYSTEMS  SUBROUTINES  FOR  OVERLAY, 
CRT  CRT  COMMUNICATIONS,  RANDOM. 
I/O*  AND  CLOCK  FUNCTIONS 


f i 


mat&iw 


js|- 

0; ' . 


I G 


r>m 





025,3. 


OBJECT  DECKS  FOR 
QVRY1,  SlKPAM,  PEOPLE,  HOUR, 
ERROR 


B25 , 2 


OBJECT  DECKS  FOR 
OVRLY2, ASPIRE,  POIS  AND  RANDOM 
NUMBER  GENERATOR  SUBROUTINES 


C25 , 1 


OBJECT  DECKS  FOR 
MESGEN  SUBROUTINES 


C25,2 


OBJECT  DECKS  FOR 
MANDET,  PROC,  SUBJEK  SUBROUTINES 


C25, 3 


OBJECT  DECK  FOR 
RESHR  SUBROUTINE 


B25.S 


OBJECT  DECKS  FOR 
OVRLY3,  RESET,  BACKLOG,  ITSUM, 
RUNSUM  AND  RANDOM  NUMBER  GEN- 
ERATOR SUBROUTINES 


B25.4 


OBJECT  DECK  FOR 
EXPER  SUBROUTINE 


7 RUN 
9 


gg  (EOF  CARD) 


NOTES : 


A indicates  a multi-punched  column:  +,0,7,9 
B indicates  a multi-punched  column:  +,0,3, 7, 9 
C indicates  a multi-punched  column:  +,0,2, 7, 9 


1 


The  Disc  to  Printer  Program  reads  and  prints  the  output  file 
generated  by  the  interactive  program.  The  program  is  executed  in 
foreground  mode  and  can  be  run  any  .time  following  completion  of  a 
simulation  run  in  the  interactive  mode  to  obtain  the  results  of 
that  simulation. 


g JOB,  CS-A-18,  *NAME* , 112,  NP,  ND 

g FET,  APS-SIM,  APS-SIM-BCD-OUT , 256,,, 

7 OPEN,  2 
9 

7 LOAD 
9 


OBJECT  DECES  FOR 
DISC-TO-PRINTER  AND 
RANREAD  PROGRAMS 


9™ 

7878  (EOF  CARD) 

Output  from  the  execution  of  this  program  is  a list  of  the 
interactive  computer  program  output. 
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ii ipufc  Data 

This  section  presents  the  formats  required  for  preparing  input 
data  for  the  TOSS  computer  program  *with  experimenter/subject  inter- 
face. For  each  input  data  field  on  a computer  card,  the  appropriate 
card  columns  (cc)  and  FORTRAN  format  (FF)  are  given.  An  "I"  format 
requires  that  the  input  value  be  right  justified  in  the  field  with 
an  "f " format  requires  right  justification  only  if  no  decimal  point 
Is  included;  it  is  desired  to  override  the  position  of  the  point 
defined  in  the  format;  an  "A"  format  indicates  that  characters  are 
entered  into  arrays  without  conversion. 


CARD  1 (prestored  message  data) 


cc:  1-2 
3-4 


Number  of  TOS  formats  in  input  data 
Number  of  prestored  messages  in  input 
data 


CARD  2 (number  of  cards  to  describe  TOS  format) 
cc:  1-2  FF:  12  Value  must  not  exceed  15 


CARD  3 (TOS  formats) 


The  format  is  prepared  in  the  same  manner  as  a standard  FORTRAN 
format  atatement.  The  definition  of  the  data  to  be  displayed  must 
be  delimited  by  left  and  right  parentheses,  respectively.  Fields 
within  the  parentheses  must  be  separated  by  commas.  Two  types  of 
fields  are  permitted: 

•Spaces-  tc  insert  m spaces  in  the  display  enter  mx. 

•Character  string  - to  insert  a string  of  m characters, 
enter  the  character  string  immediately  preceded  by  mil. 

For  example,  to  produce  the  string  "A  TEST",  enter 
6HA  TEST. 

The  sum  of  the  characters  presented  in  the  format  cannot  exceed 
1000.  The  screen  is  formatted  into  20  lines  of  50  characters  each. 
CARD  2 and  CARD  3 are  repeated,  in  sequence,  for  each  TOS  format 
desired. 
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CARD  4 (prestored  message) 


cc;  1-2  FF  12  Sequential  order  of  the  TOS  format 

(input  in  CARD  2,  CARD  3)  associated 
with  this  message 

3-4  12  Number  of  responses  for  this  message 


CARD  5 (message  responses) 

cc:  1-3  FF:  13  Number  of  characters,  from  the  screen 

origin  (character  1»  line  1),  to  skip 
before  message  response 

4-5  12  Number  of  characters  in  response 

6-40  35A1  Character  string  representing  correct 

message  response 

CARD  5 is  repeated  in  sequence,  ior  each  response  in 
the  message. 


CARD  4 and  CARD  5 are  repeated  for  each  prestored 
message  desired. 


CARD  6 (mission  title) 

cp:  1-72  FF:  18A4  72  character  mission  title 


CARD  7 (simulation  parameters) 


cc:  1-3 

FF:  13 

NSHIFT — number  of  iterations  before 
mission  .summary  is  prepared 

4-5 

12 

IHMAX — number  of  hours  per  shift 

6 

XI 

MEN(l) —number  of  type  1 operators 
(action  officers) 

7 

11 

MEN(2)--number  of  type  2 operators 
(IOD  operators) 

I 


cc:  8-9  FF: 

2X 

not  used 

10 

11 

0R0(1) — if  1,  print  input  data 

11 

11 

0R0(2)—  print  hourly  message  queue 

12 

11 

not  used 

13 

11 

0R0(4)~- if  1,  print  task  element  detail 

14 

11 

0R0(5) — if  1,  print  message  processing 

15 

11 

0R0(6) — if  1,  print  hour  and  iteration 
summary 

16-18 

3X 

not  used 

19-20 

12 

IDAY — day  number  of  mission  simulated 

21-22 

12 

BKLG — number  of  messages  in  A0/G3  inbox 
at  beginning  of  shift 

23-24 

2X 

not  used 

25-29 

F5.3 

PUL — probability  of  a nonimportant  un- 
detected error  in  central  con^-^cer 

30-34 

F5.3 

PUS — probability  of  a significant  error 
in  the  central  computer 

35-39 

F5.3 

SRTA--system  response  time  to  an  inquiry 

40-44 

F5.3 

SRTS — standard  deviation  of  SRTA 

45 

11 

IATA(1,1)— sequential  order  of  task  analysis 
to  be  used  for  operator  type  1 processing  a 
message  type  1 

46 

11 

IATA(1,2) — for  message  type  2 

47 

11 

IATA(l»'.) — for  message  type  3 

48 

11 

IATA(1,4) — for  message  type  4 

49 

11 

IATA(1,5) — for  message  type  5 

5C 

11 

IATA(1,6) — for  message  type  6 

B-13 


r 

w 
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it 

« 

i 


-a 

1 

J 


51  FF: 

11 

IftTA(l»7) — for  message  type  7 

; SJ 

# 

yt 

52 

11 

IATA(1,8)— for  message  type  8 

I I 

f 

53 

11 

I ATA( 2,1)— operator  type  2/message 
type  1 

1 

| 

4 

1 

54 

11 

TATA(2, 2)— Operator  type  2/message 
type  2 

l 

j 

55 

11 

IATA(2,3) — operator  type  2/message 
type  3 

i 

% 

i 

-'A 

56 

11 

I ATA( 2,4) —operator  type  2/message 
type  4 

i 

{ 

a 

i 

57 

11 

1ATA(2,5) — operator  type  2/message 
type  5 

! j 

58 

11 

IATA(2,6)— operator  type  2/message 

type  6 

1 

59 

11 

IATA(2, 7)— operator  type  2/message 
type  7 

j 

1 

60 

11 

IATA(2,3) — operator  type  2/message 
type  $ 

1 | 

i 

< 

% 

61-63 

.13 

NTE— total  number  of  task  elements 
jn  all  task  analysis 

i 

71 

1 

j 

64-70 

A8 

Y— eight  digit  positive  odd  octal 
number  used  to  initialize  random 
number  generator 

7 

A 

1 

' i 

s 

72 

11 

EX1H £f  1,  experimenter  interface 

affected 

j j 

73 

11 

iSCRN — screen  number  for  experimenter 

74 

11 

HARD — hard  cppy  option  for  CRT  displays: 

s 

'■» 

f. 

0- none 

1- for  viewers'  responses 

2- for  displays  to  viewers 

3 - both  1 and  2 

i 

s 

■> 

3j 

75 

11 

SBIN — if  1 , subject  interface  effected 

* 

'i 

' I 

* 

j ;S1 

i % 

i 


F, 


| >j  ’ ' 


wt  1 


CARD  8 (option  for  operator  parameters) 


i 


HSK.  ; 

m ' 


FF:  II  ISKIP— if  1,  then  CARD  9 and  CARD  10 

will  riot  be  present.  This  option  can 
be  used  in  a multiple-run  situation 
when  values  of  parameters  for  the  current 
run  are  to  remain  as  they  were  for  the 
previous  run 


CARD  9 (operator  names) 

cc:  1-4  FF:  A4  NAME  1— name  of  operator  1 

5-8  A4  NAME  2 — name  of  operator  2 


(up  to  6 operators  can  be  named) 


m ^ 


o 


CARD  10  (operator  parameters) 

cc:  1 FF:  II  H — man  number  (from  1 to  6) 

2-4  3X  not  used 

5-9  F5.3  FtMj^-apaed  factor  for  this  man  1.0 

Is  average;.  F(M) <1.0  indicates  faster 
than  average  win ; F(H)>1.0  indicates 
a slower  than  average  man 


10-14 


15-19 


F5.3  PREC(M)~precision  factor  for  this  man  1.0 
is  average;  PREC(M)=.8  indicates  very  high 
precision;  PREC(M)=1.2  indicates  a very  low 
precision.  The  1.2  value  is  not  to  be  used. 

F5.0  STRM(M) — stress  threshold  for  this  man.  The 
number  of  priority  messages  in  t’ne  backlog 
for  this  man  which  will  produce  a maximum 
effort. 


20-24  F5.3  ASP(M) — initial  aspiration  level  for  this  man. 

ASP(M)=1.0  is  the  highest  possible  aspiration 
level. 


CARD  10  is  repeated  for  each  roan  (up  to  6) 
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CARD  11  (sk.ip  option  for  hour  parameters) 

1 FF:  II  ISKIP— if  1,  then  CARD  12  and  CARD  13 

will  not  be  present  (see  CARD  8) 

CARD  12  (names  of  message  types) 

cc:  1-4  FF:  A4  MMTYP(l) — name  of  message  type  1 

5-8  A4  NMTYP(2) — name  of  message  type  2 

* • t 

• • • 

• • • 

* • • 

• • mr 

(up  to  7 message  types  can  be  named) 

CARD  13  (hour  parameters) 


ce:  1-2 

FF:  12 

IH — hour  number  (from  1 to  12) 

3-4 

12 

IGP(IH) — number  of 'messages  arriving  in 

AO/83’8  in  box  in  last  15  minutes  of  this 
hour 

5-6 

12 

XQR(XH) — number  of  messages  arriving  in 

AO/63' s inbox  randomly  throughout  this 
hour 

7-8 

12 

IUR(IH) — not  used 

9 

IX 

not  used 

10-14 

F5.0 

FRET(1,IH)— cumulative  proportional  occourance 
of  message  type  1;ADD 

15-19 

F5.0 

FRET(2,IH)— type  2: CHANGE 

20-24 

F5.0 

FRET(3,IH)— type  3: DELETE 

25-29 

F5.0 

FRET(4,IH)— type  4: QUERY 

30-34 

F5.0 

FRET(5,IH) — type  5: RELAY 

35-39 

F5.0 

FFET(6,IH) — typs  6:SPR 

40-44 

F5.0 

FR£T(7,IH)— type  7: SRI 
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cc; 45-49 

FF: 

F5.0 

FREP(1,IH) — cumulative  proportional 
occourence  of  messages  of  priority 
type  1: ROUTINE 

1 

h 

50-54 

F5.0 

FREP(2,IH)— priority  type  2: PRIORITY 

! 

} 

1 

55-59 

F5.0 

FREP(3,IH)i~priority  type  3 OPERATIONAL 

IMMEDIATE 

« 

60-64 

F5.Q 

FREP(4,IH)— priority  type  4; FLASH 

■£ 

y 

'i 

65-69 

F5.0 

FREP(S,IH>— priority  type  5 PRESIDENTIAL 

£ 

i 

INTERRUPT 

■s 

? 

70-74 

F5.0 

FRER(IH)-~frequency  of  arrival  of  routine 
messages  this  hour 

1 

75-79 

F5.0 

FREQ(IH) — frequency  of  arrival  of  other 
than  routine  messages  this  hour 

3 

I 

l 

CARD  13  Is  repeated 

for  IBMAX  hours 

I 

? 

i 

> 

CARD  14  (skip  option  for  error  data) 

\ 

i 

cc:  1 

FF: 

11 

ISKIP—if  1,  then  CARD  15  will  not  be 

present  (see  CARD  8) 

\ 

CARD  15  (error  data) 

\ 

cc:  1 

FF: 

11 

IE— indicator  for  error  type:  1=C0MMISSI0N 

2=  ABBREVIATION,  TYPOGRAPHICAL  OR  SPACING 

3=  0MMISSI0N,  4=  OTHER 

\ 

y 

2-9 

F8.2 

ER( IE ,1)— error  rate  per  100  characters  for 

i 

message  type  1 

> 

10-17 

F8.2 

ER(IE,2)— for  message  type  2 

j 

18-25 

F8.2 

ER(IE,3) — for  message  type  3 

] 

26-33 

F8.2 

ER(IE,4) — for  message  type  4 

•i 

34-41 

F8.2 

ER(IE,5)— for  message  type  5 

42-49 

F8.2 

ER(IE,6) — for  message  type  6 

* 
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cc : 50-67 

FF: 

F8.2 

ER(IE,7)— for  message  type  7 

58-65 

8X 

not  used 

66-72 

F7.2 

EPRG- -percentage  of  G3/A0  errors  which 
produce  error  routines 

73-79 

F7.2 

ERPI — percentage  of  UI0D  operator  errors 
which  produce  error  routines 

CARD  15  is 

repeated  4 tiroes,  once  for  each  error  type 

CARD  16  (skip 

option  for  message  length  data) 

cc:  1 

FF: 

11 

1SKIP— if  1,  then  CARD  17  and  CARD  18 
will  not  be  present  (see  CARD  8) 

CARD  17  (message  length  data) 

cc:  1-10 

FF: 

F10.2 

IMCd)- -number  of  characters  in  trans- 
formed message  type  1 

11-20 

F10.2 

IKC(2) — fop  message  type  2 

21-30 

F10.2 

INC(3)' — for  message  type  3 

31-40 

F10. 2 

IHC(4)--ft>r  message  type  4 

42-50 

F10.2 

INC(5) — for  message  type  5 

51-60 

F10.2 

INC(6)— for  message  type  6 

61-70 

F10.2 

INC(7) — for  message  type  7 

CARD  18  (message  length — standard  deviations) 

cc:  1-10 

FF: 

F10.2 

INS(l) — standard  deviation  of  INC(l) 

11-20 

F10.2 

INS(2) — standard  deviation  for  INC(2) 

21-30 

F10. 2 

INS(3) — standard  deviation  for  INC( 3) 

31-40 

F10.2 

INS (4) — standard  deviation  for  INC(4) 

' 1 ^ * r''~‘^r^\'^'^‘“y'.'t'-P’'t'‘‘'~i':^V/'>'):rPi^'je'frU^'\ S'jS 


wi^g^^yjn^wai  ii  ■jypi|i|.  j '.  in  ' 


cc:41-50  FF:  F10.2  INS(5)--standard  deviation  for  TNC(5) 

51-60  F10. 2 INS(6) — standard  deviation  for  INC(6) 


51-60 

61-70 


F10. 2 INS(7) — standard  deviation  for  INC(7) 


CARD  19  (skip  option  for  task  analysis  data) 

cc:  1 FF:  II  ISKIP— if  1,  then  CARD  20  will  not  be 

present  (see  CARD  8) 


I 4t 


gg 

n 


CARD  20  (task  analysis  data) 
cc:  1-2  FF:  12  K — task  analysis  number 

3-5  13  I — task  element  within  this  analysis 

5 IX  not  used 

7 A1  JTYPE(I,K)-*task  element  type:l=task 

element  which  may  be  rejected  with 
prohiitbility  specified  by  AVPROB(I.K); 

2=ta*k  element'  in  which  number  of 
characters  for  this  message  type  will  be 
multiplied  by  statistically  determined 
mean  time  to  produce  transformation  time 
for  message j 3*decision  task  element  in 
which  operator  factors  such  as  speed, 
precision,  and  stress  level  ate  not 
allowed  to  affect  duration  of  task  element; 
4=an  equipment  task  element  for  which  ope- 
rator factors  are  ignored  and  task  element 
can  not  be  failed;  (5=not  used);  6=special 
type  of  branch  task  element  in  which  either 
a "COR"  or  "ERR"  response  is  expected. 

8 A1  CRIT(I, JO—  criticality  indicator  for  task 

element:  "C"  for  critical,  otherwise  not 
critical 

9 IX  not  used 


§■ 


END(I,K) — number  of  message  processing 
segment  ended  by  this  task  element.  Leave 
blank,  if  none. 

not  used 
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12  FF:  13 


15-17 

18-19 

20-19 

30-29 

40-49 


51-56 


IJF(I,K) — numiK'v-  of  the  task  element 
within  this  task  analysis  which  will 
follow  this  one  if  this  element  is 
failed 

IJS( I »K)- -number  of  task  element  within 
which  this  analysis  which  will  follow  this 
one  if  this  task  element  is  a success 

not  used 


F10.0  ACGTM(I }K) — mean  performance  time  for  this 
task  element 

F10.0  SIGJ1A(X,K) — standard  deviation  for  AUGTM(I,K) 

F10.0  AVPR0B(  I, K)— probability  of  success  for  this 
task  eieme-  If  JTYPE(I,K)=1,  then  AVPROB 
(I,K)  is  p. obability  of  message  rejection 

A1  UETYPEi I,K)undetected  type  for  this  task 

element : "T"  for  transform,  not  "T"  for  all 
others 

F6.3  — probability  for  undetected  error 

for  this  task  element 


CARD  20  is  repeated  HTE  times  (CARD  7,  columns  61-63) — 
once  for  each  element 


CARD  21  (skip  option  Joy  effectiveness  components) 

cc:  1 FF:  If  ISKIP— if  1,  CARD  22  will  not  be  present 

(see  CARD  3) 


CARD  22  (effectiveness  components) 


1-5 

FF;  F5.3 

CC}2 — correlation  between  thoroughness  and 
completeness 

6-10 

F5.3 

CC13 — correlation  between  thoroughness  and 
responsiveness 

11-15 

F5.3 

CC14 — correlation  between  thoroughness  and 
accuracy 

B-20 
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cc: 16-20 

FF:  F5.3 

CC2 3— correlation  between  completeness  and 
responsiveness 

21-25 

F5.3 

CC24— ' -correlation  between  completeness  and 
accuracy 

26-30 

F5.3 

CC34 — correlation  between  responsiveness 
and  accuracy 

31-3b 

F5.3 

W(l) — relative  weight  of  thoroughness  in 
computing  overall  effectiveness 

36-40 

F5.3 

H( 2)»— relative  weight  of  completeness 

41-45 

F5.3 

W(3) — relative  weight  of  responsiveness 

46-50 

F5.3 

W(4) — relative  weight  of  accuracy 

CARD  23  (repeat  option) 

Cc:  1 FF:  II  I REP— If.  1,  another  set  of  input  data  cards 

follow;  otherwise,  terminate  computer  program 


Operating  Instructions 


Input  data  are  prepared  and  punched  on  computer  cards.  These 
cards  are  inserted  into  the  CARD-TO-DISC  program  deck  and  the  disc- 
pack  reserved  for  the  interactive  model  is  mounted  on  an  available 
disc  drive.  The  program  is  executed  in  the  foreground  mode,  re- 
sulting in  a list  of  the  data  (which  may  be  checked  for  errors)  and 
writing  of  the  input  file  to  the  disc.  The  input  file  will  remain 
on  disc  until  the  next  execution  of  CARD-TO-DISC. 

The  interactive  program  is  executed  in  background  mode  so  that 
the  card  reader  and  printer  are  not  available  to  the  program.  The 
disc  pack  reserved  for  the  interactive  model  must  be  mounted  during 
program  execution. 

A list  of  the  results  of  the  most  recent  simulation  run  is 
obtained  by  executing  the  DISC-TO-PRINTER  program  in  foreground  mode. 
Again,  the  disc  pack  must  be  mounted  when  DISC-TO-PRINTER  is  executed. 
Information  Displays  are  routed  to  the  experimenter's  screen  at 
varous  times  during  and  following  a simulation  run.  for  each  display, 
execution  of  the  computer  program  will  nut  resume  until  the  experi- 
menter depresses  the  SEND  key  on  the  keyboard. 

In  displays  requiring  experimenter  input,  some  care  is  required 
in  depressing  the  SEND  key.  Many  of  the  numerical  fields  displayed 
are  juxtapositioned.  Thus,  if  the  experimenter  replaces  a numerical 
value  in  a field  and  causes  a SEND  character  to  be  placed  in  the 
first  position  following  the  field,  the  SEND  character  is  actually 
placed  in  the  second  field.  In  most  cases,  this  sequence  will  cause 
the  value  of  the  field  containing  the  SEND  character  to  be  interpret- 
ed as  zero.  An  easy  way  to  avoid  this  problem  Is  to  depress  the 
RESET  key  immediately  prior  to  depressing  the  SEND  key. 

If  the  subject  interface  option  is  ip  effect,  communication  is 
established  with  the  subject  when  he  is  to  enter  message  reponses 
on  his  screen.  First,  he  receives  a message  announcing  that  a TOS 
format  will  be  displayed  on  his  screen.  When  he  is  ready  to  input 
his  responses,  he  depresses  the  SEND  key.  The  computer  program 
starts  to  time  subject  response  time  when  it  displays  the  TOS  format. 
When  the  subject  has  completed  entering  his  message,  he  again  depresses 
the  SEND  key  to  signal  the  computer  to  compute  bis  performance  time 
As  with  the  experimenter,  any  time  the  subject  receives  an  informa- 
tion display  ( his  incorrect  reponses,  for  example),  he  must  depress 
SEND  before  the  computer  program  will  resume  execution. 
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APPENDIX  C 

MAIN  SEQUENCE  LOGIC  FLOW  FOR  TOS  INTERACTIVE  MODEL 


TO  RAGE  C-4 


GO  TO  PAGE  C-5 


1 


5*;2 

Jg 

$§ 


a 

o 

« 

***r 

u. 

to 

5 

to 

a 

5 

CL 

ce 

e 

f2 

a 

to 

o 

u. 

to 

Y~ 

z 

h 

O 

to 

3 

UJ 

o 

-1 

CO 

Ui 

to 

p 

5 OK- 
< 

uuiffle 
Ui  to  3 tt  ui 
Sz«po 
< o _ o < 
Sl  o.  5 -t  to 
5»Of  « 
O UJ  X - UJ 

otn-il 


UI 

3 

ft 

Ui 

ao 

ft.  z —» 

£5N 

CL  3d 
§U« 
a <2  * 

l§! 

m c 2 

8 u.  u. 


u.  3 w j5 

o^olr 

,.  K tul-  5 
lil  o ^ H 

s il 

r;  t In 

ODONhS 

<«•- 


o 

h- 

to 

5£ 

S 

O 

Ui 

O 

-a 

_l 

CO 

u 

3 

H 

to 

(E 

Ui 

J* 

I 

H 

5 

s 

a: 

e 

g s 

P o 

h UJ 

“3 

>■  03 

<X  3 
-I  <0 

a. 

to  o 
Q I- 


III 

5ok 


& fe-O 

s°§ 


. 6 to 

juffc  8 

. Jl.  O 
i 3 C 3 
! 2 to  w 


it* 


h 

hF 

J<  O 

uio  A 
l- 1-  sic 

fill 

oo  ul  <B  ui 


£ V)  u.  — 

g3*i*5 

ntti 

H •'  £ " “ 
M . z»~ 


s^=:=a, 

JO uCh s 
3 C c.  5 


^ a m « m a 
3F^£w-< 
Jgtotj 

g*S38S 

le&Sti 


=i«  » 

1BSSS 

fc§=sc 

U H f A _J  ll_ 


o — \ . 
o«dS: 

:§3g3 


tc 

a in 
o“  + 


<i  z? 

UJ  ••  » o S — 

£gsE»4c 

2ISz5fslg 

>i  xg—  to  “ u-  ^ u 
5 Fo  -j  -s  *'  cc 

§ u.R  ~ 


JL 


i 


s:b  = 
I ill- 

lii  — < 3 


u.  u 
11  cc 

)H  fl» 

II  S ffi 
« w z 


£ is  % 


■ &.  i 


a u 

1 Si 

2 Sk 

N< 

gol 

wr> 


logs 

3EW  or 
cor 

3§5S 

?§2S 

II  Zb 
©I  ii 
(9  <M 

M «• 


iu|8 

»°3 

co0“o: 

ujP.o: 

vofe 
3 Q.S 

~i 

<Uioe 

PtKO 


m 


V 


mwm w 


on  2 


Q <2 
< 3 (E 

UJ  {3  o 
NeI 

So  UJ 
Ski 

|8H 

in  g O 


1 x 

® - 

hkh 

j-  2 
ui  o 

CO  X 


<0 

z 

o 

i-  <\- 

Q.  _ 

0 S 
J-  “ 

z a 

a £ 

01  o 


CO 

H 

U. 

X <*• 
CO  til 
“■  H 
co  < 
Z =J 
=>  2 
K 5 

UI  CO 

ac  „ 


UI 

U- 

M 

o 

CE 

< 

CO 

2 

b 

t- 

2 

3 

H 

3 

CO 

t~ 

CO 

UJ 

O 

(E 

1 — 

O 

A 

5 

CO 

Z 

_j 

H 

CL 

u. 

X 

CO 

X 

o 

5 

CO 

H 

Q 

_l 

u. 

Z 

_} 

_H 

< 

< 

Si ' 


< UI  2 

2 O + 
CE  < =J 

o <0  j? 

U.  CO  & 

3aS 

UJX  u 

• — i — 

’ . ' w 
gSo 

Rom 


feg» 

CO  t-  H 

CO  u UJ 
UJ  o Z 

z ° o 

IxJ  Z °* 
>02 
H P o 
O o ° 

UJ  7 
lu  S CO 

ui  j?  co  >. 

UJ  ^ UJ  o 

4*  Z ^ 

uj<  u 5 

CO  > 3 


I r-  V 

={  o u 
R k w < 
P z>  u. 


CO 

CO  CO 
m y CO 

S Zui 
£ w Z 

I>IU 
a co  J- 

3 z y 
o o =*  ; 
a cl  ^ 
o to  2 
x UJ  o 

H X o 


3 2 <0  < W pc 
CO  X bjigts 

S 

U!  § OC  “•  < O U- 

? wS5a8.2 


iSSfigs 

% £ fcoo< 


o 
cc 
S O 
^ P U- 
CO  ^ H 

Z K X 

O Q CO 

CC  Z z 

£ U o § 

M jsj  « 

* H ~»2 
3 K h r 

o < J % 
ft  |Se. 
cc  2 J3  ui  ’ 
D r>  " t 

CO  CO  O-  — 


|BS» 


C-13 


